2026-03-27 22:45:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 22:45:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 22:45:06 [ayvens.be] INFO: Starting spider ayvens.be
2026-03-27 22:45:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 22:45:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 22:45:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 22:45:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 22:45:06 [scrapy.extensions.telnet] INFO: Telnet Password: 87feba305c5a189f
2026-03-27 22:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 22:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.be/task_34_2026-03-27T22_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 22:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 22:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 22:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 22:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 22:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 22:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-27 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-27 22:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 22:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 22:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 22:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 22:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 22:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 22:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 22:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 22:45:12 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 22:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-27 22:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-27 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-27 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-27 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 22:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [ayvens.be] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'oB8mH20GcmuPej0vDQZHBU|2026-03-27T22:45:17.573Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806187517, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'leaNNCXNJxvw43h7eitD59|1774651519045|1774651519045', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774653319, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-27 22:45:19 [ayvens.be] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'oB8mH20GcmuPej0vDQZHBU|2026-03-27T22:45:17.573Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'leaNNCXNJxvw43h7eitD59|1774651519045|1774651519045', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-27 22:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-27 22:45:19 [ayvens.be] INFO: Intercepting token...
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-27 22:45:19 [ayvens.be] INFO: Scrolling element to trigger lazy load...
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-27 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/reset.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/reset.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/it.svg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gd3/a8557dd17ea44c5c9159acc50d7125dd/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/89337bd568314dfabfaf97a4a1c30420/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/medium/0.jpg>
2026-03-27 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gj6/89337bd568314dfabfaf97a4a1c30420/images/medium/0.jpg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/medium/0.jpg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gd3/a8557dd17ea44c5c9159acc50d7125dd/images/medium/0.jpg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2es/638064995cc140a588820da47bfa1aec/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2es/638064995cc140a588820da47bfa1aec/images/medium/0.jpg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/medium/0.jpg>
2026-03-27 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/powered_by_logo.svg>
2026-03-27 22:45:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744>
2026-03-27 22:45:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c&gtm=4e63q0h2> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c&gtm=4e63q0h2> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c&gtm=4e63q0h2>
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c&gtm=4e63q0h2>
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5100472432532;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dxgcHErjA5XgXhxIkrJXd0Y5m4sKIwE2_w;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5100472432532;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dxgcHErjA5XgXhxIkrJXd0Y5m4sKIwE2_w;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&_p=1774651521651&_gaz=1&gcd=13l3l3l3l1l1&npa=0&dma=0&cid=1233789229.1774651523&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=0~115616986~115938466~115938468~117484252&sid=1774651523&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=204282&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=10352> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=1233789229.1774651523&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115616986~115938466~115938468~117484252> (resource type: other, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=1233789229.1774651523&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115616986~115938466~115938468~117484252&z=1541062491> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [ayvens.be] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Response: <204 https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&_p=1774651521651&_gaz=1&gcd=13l3l3l3l1l1&npa=0&dma=0&cid=1233789229.1774651523&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=0~115616986~115938466~115938468~117484252&sid=1774651523&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=204282&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=10352>
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots> (resource type: image, referrer: https://4340043.fls.doubleclick.net/)
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-27 22:45:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=1233789229.1774651523&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115616986~115938466~115938468~117484252&z=1541062491>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5100472432532;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dxgcHErjA5XgXhxIkrJXd0Y5m4sKIwE2_w;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=1469146731.1774651523;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots> (resource type: image, referrer: https://4340043.fls.doubleclick.net/)
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.62f3e2b80275d2c67f53.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/me.42217d3094fdefbb5607.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=5535641513995;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_-Krji6kJTxMaAC9kilMc2PyBDzSE-SJHuw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots>
2026-03-27 22:45:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=4055378218976;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63q0h2v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115938466~115938468~117266401~117484252;epver=2;dc_random=1774651523_dFZG8Dmj58lLWB7dJ8qS1KGWrhqftlU5Cw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots>
2026-03-27 22:45:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js>
2026-03-27 22:45:25 [scrapy-playwright] DEBUG: [Context=default] Response: <204 https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=1233789229.1774651523&gtm=45je63q0h2v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115616986~115938466~115938468~117484252>
2026-03-27 22:45:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.62f3e2b80275d2c67f53.js>
2026-03-27 22:45:25 [ayvens.be] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-27 22:45:25 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-27 22:45:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:45:28 [ayvens.be] INFO: Found listing with ID: 1987594
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987594%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [ayvens.be] INFO: Scrape type for 1987594: 1
2026-03-27 22:45:28 [ayvens.be] INFO: Extracting data for car ID: 1987594
2026-03-27 22:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1987594
2026-03-27 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/1.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/2.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/3.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/4.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/5.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/6.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/7.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/8.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/9.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/10.jpg not downloaded yet
2026-03-27 22:45:28 [ayvens.be] INFO: Found listing with ID: 1987595
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987595%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [ayvens.be] INFO: Scrape type for 1987595: 1
2026-03-27 22:45:28 [ayvens.be] INFO: Extracting data for car ID: 1987595
2026-03-27 22:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1987595
2026-03-27 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 1
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/1.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/2.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/3.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/4.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/5.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/6.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/7.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/8.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/9.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/10.jpg not downloaded yet
2026-03-27 22:45:28 [ayvens.be] INFO: Found listing with ID: 1987596
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987596%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [ayvens.be] INFO: Scrape type for 1987596: 1
2026-03-27 22:45:28 [ayvens.be] INFO: Extracting data for car ID: 1987596
2026-03-27 22:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1987596
2026-03-27 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 1
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/1.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/2.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/3.jpg not downloaded yet
2026-03-27 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/4.jpg not downloaded yet
2026-03-27 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/5.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/6.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/7.jpg not downloaded yet
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/8.jpg not downloaded yet
2026-03-27 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/9.jpg not downloaded yet
2026-03-27 22:45:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 22:45:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5324d50>
2026-03-27 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/1.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fc690>
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/3.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/10.jpg not downloaded yet
2026-03-27 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:29 [ayvens.be] INFO: Found listing with ID: 1987597
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987597%27 HTTP/1.1" 200 None
2026-03-27 22:45:29 [ayvens.be] INFO: Scrape type for 1987597: 1
2026-03-27 22:45:29 [ayvens.be] INFO: Extracting data for car ID: 1987597
2026-03-27 22:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1987597
2026-03-27 22:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 1
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/1.jpg not downloaded yet
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a78d0>
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/5.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b1f90>
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/4.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/2.jpg not downloaded yet
2026-03-27 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/3.jpg not downloaded yet
2026-03-27 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459edd0>
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/6.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a5a10>
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/2.jpg saved to cache
2026-03-27 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/4.jpg not downloaded yet
2026-03-27 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/5.jpg not downloaded yet
2026-03-27 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/6.jpg not downloaded yet
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ffb50>
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/8.jpg saved to cache
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547d210>
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/7.jpg saved to cache
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a750>
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/10.jpg saved to cache
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/7.jpg not downloaded yet
2026-03-27 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/8.jpg not downloaded yet
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547ed50>
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd04ad086b12449918e248639941a499e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/9.jpg saved to cache
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-27 22:45:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f987ca01-5c91-5382-9e54-a5af158d6ca0, skipping ID generation
2026-03-27 22:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-03-27 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f987ca01-5c91-5382-9e54-a5af158d6ca0 sending to next pipeline
2026-03-27 22:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f987ca01-5c91-5382-9e54-a5af158d6ca0, identifier: 1987594
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dde50>
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/1.jpg saved to cache
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/9.jpg not downloaded yet
2026-03-27 22:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1987594
2026-03-27 22:45:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1987594
2026-03-27 22:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1987594 to the API
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'lpg',
 'id': 'f987ca01-5c91-5382-9e54-a5af158d6ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 118163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d04ad086b12449918e248639941a499e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'transmission': 'automatic',
 'trim': '2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'vin': None,
 'year': 2020}
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987594%27 HTTP/1.1" 200 None
2026-03-27 22:45:31 [ayvens.be] INFO: Saving data for 1987594: {'created_time': 1774651531.839973, 'last_price_update_time': 1774651531.839988, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987594') HTTP/1.1" 204 0
2026-03-27 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/10.jpg not downloaded yet
2026-03-27 22:45:31 [ayvens.be] INFO: Found listing with ID: 1987598
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987598%27 HTTP/1.1" 200 None
2026-03-27 22:45:31 [ayvens.be] INFO: Scrape type for 1987598: 1
2026-03-27 22:45:31 [ayvens.be] INFO: Extracting data for car ID: 1987598
2026-03-27 22:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1987598
2026-03-27 22:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 1
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/1.jpg not downloaded yet
2026-03-27 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c9390>
2026-03-27 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/2.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/2.jpg not downloaded yet
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/3.jpg not downloaded yet
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5432e10>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/3.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342a50>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/4.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45afa90>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/5.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/4.jpg not downloaded yet
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/5.jpg not downloaded yet
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/6.jpg not downloaded yet
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f810>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/6.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541a4d0>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/4.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fe550>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/3.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cd390>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/7.jpg saved to cache
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/7.jpg not downloaded yet
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/8.jpg not downloaded yet
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fda90>
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/8.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/9.jpg not downloaded yet
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/10.jpg not downloaded yet
2026-03-27 22:45:33 [ayvens.be] INFO: Found listing with ID: 1987599
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987599%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [ayvens.be] INFO: Scrape type for 1987599: 1
2026-03-27 22:45:33 [ayvens.be] INFO: Extracting data for car ID: 1987599
2026-03-27 22:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1987599
2026-03-27 22:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 1
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/1.jpg not downloaded yet
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d722f9d0>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/1.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e53d0>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/9.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459d590>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/10.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/2.jpg not downloaded yet
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/3.jpg not downloaded yet
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4533950>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/2.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/4.jpg not downloaded yet
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/5.jpg not downloaded yet
2026-03-27 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/6.jpg not downloaded yet
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5425710>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/3.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c70d0>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/5.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ba610>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/6.jpg saved to cache
2026-03-27 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c5d90>
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/7.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/7.jpg not downloaded yet
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/8.jpg not downloaded yet
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342950>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/1.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4522650>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/8.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d452b650>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/9.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524850>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/6.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/9.jpg not downloaded yet
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/10.jpg not downloaded yet
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [ayvens.be] INFO: Found listing with ID: 1987600
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987600%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [ayvens.be] INFO: Scrape type for 1987600: 1
2026-03-27 22:45:34 [ayvens.be] INFO: Extracting data for car ID: 1987600
2026-03-27 22:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1987600
2026-03-27 22:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 1
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/1.jpg not downloaded yet
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45854d0>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/4.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/2.jpg not downloaded yet
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/3.jpg not downloaded yet
2026-03-27 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d2bd0>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/3.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a6910>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/2.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d559b790>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/6.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549290>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/5.jpg saved to cache
2026-03-27 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d2bd0>
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/9.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/4.jpg not downloaded yet
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548250>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/10.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4564590>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/1.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/5.jpg not downloaded yet
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/6.jpg not downloaded yet
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4597c90>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c78536dacfd45c4aa2f589e24fe9967%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/4.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-27 22:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11e9e431-e1c0-5822-8d85-cbcc241018e1, skipping ID generation
2026-03-27 22:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 1
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 sending to next pipeline
2026-03-27 22:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 11e9e431-e1c0-5822-8d85-cbcc241018e1, identifier: 1987597
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2090>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/4.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478810>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/2.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b1550>
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/8.jpg saved to cache
2026-03-27 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1987597
2026-03-27 22:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1987597
2026-03-27 22:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1987597 to the API
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '11e9e431-e1c0-5822-8d85-cbcc241018e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 128654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c78536dacfd45c4aa2f589e24fe9967/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987597%27 HTTP/1.1" 200 None
2026-03-27 22:45:36 [ayvens.be] INFO: Saving data for 1987597: {'created_time': 1774651536.340712, 'last_price_update_time': 1774651536.340723, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987597') HTTP/1.1" 204 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/7.jpg not downloaded yet
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/8.jpg not downloaded yet
2026-03-27 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45810d0>
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/10.jpg saved to cache
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571b4d0>
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/3.jpg saved to cache
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557aed0>
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F6c5e8f4de14f42029b04674dedcf076b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/7.jpg saved to cache
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-27 22:45:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f32502b7-c4ac-5350-8b50-67b8224804a5, skipping ID generation
2026-03-27 22:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 1
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f32502b7-c4ac-5350-8b50-67b8224804a5 sending to next pipeline
2026-03-27 22:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f32502b7-c4ac-5350-8b50-67b8224804a5, identifier: 1987598
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a34d0>
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/5.jpg saved to cache
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fc210>
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/6.jpg saved to cache
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/9.jpg not downloaded yet
2026-03-27 22:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1987598
2026-03-27 22:45:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1987598
2026-03-27 22:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1987598 to the API
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f32502b7-c4ac-5350-8b50-67b8224804a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/6c5e8f4de14f42029b04674dedcf076b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (110KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (110KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987598%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [ayvens.be] INFO: Saving data for 1987598: {'created_time': 1774651537.304999, 'last_price_update_time': 1774651537.305011, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987598') HTTP/1.1" 204 0
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/10.jpg not downloaded yet
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe450>
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/8.jpg saved to cache
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4521550>
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/7.jpg saved to cache
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:37 [ayvens.be] INFO: Found listing with ID: 1987601
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987601%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [ayvens.be] INFO: Scrape type for 1987601: 1
2026-03-27 22:45:37 [ayvens.be] INFO: Extracting data for car ID: 1987601
2026-03-27 22:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1987601
2026-03-27 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 1
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/1.jpg not downloaded yet
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/2.jpg not downloaded yet
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341fd0>
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/10.jpg saved to cache
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/3.jpg not downloaded yet
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/4.jpg not downloaded yet
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/5.jpg not downloaded yet
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c5350>
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fdd4716f7fd7f41e9991f6f730ee97e5c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/9.jpg saved to cache
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-27 22:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7ee486-8742-5e66-b3be-58363099d735, skipping ID generation
2026-03-27 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 1
2026-03-27 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7ee486-8742-5e66-b3be-58363099d735 sending to next pipeline
2026-03-27 22:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1f7ee486-8742-5e66-b3be-58363099d735, identifier: 1987599
2026-03-27 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1987599
2026-03-27 22:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1987599
2026-03-27 22:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1987599 to the API
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1f7ee486-8742-5e66-b3be-58363099d735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 114773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/dd4716f7fd7f41e9991f6f730ee97e5c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987599%27 HTTP/1.1" 200 None
2026-03-27 22:45:38 [ayvens.be] INFO: Saving data for 1987599: {'created_time': 1774651538.274408, 'last_price_update_time': 1774651538.274419, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987599') HTTP/1.1" 204 0
2026-03-27 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/6.jpg not downloaded yet
2026-03-27 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/7.jpg not downloaded yet
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5586550>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/2.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d35d0>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/5.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45aead0>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/1.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d0d90>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/3.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531ded0>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/2.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541f150>
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F35be26a10e464f96b61a930aa181a092%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/1.jpg saved to cache
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-27 22:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 065560d5-73ef-5e5a-8e8e-13da0a591f77, skipping ID generation
2026-03-27 22:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 1
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 sending to next pipeline
2026-03-27 22:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 065560d5-73ef-5e5a-8e8e-13da0a591f77, identifier: 1987596
2026-03-27 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/8.jpg not downloaded yet
2026-03-27 22:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1987596
2026-03-27 22:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1987596
2026-03-27 22:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1987596 to the API
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '065560d5-73ef-5e5a-8e8e-13da0a591f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 78233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/35be26a10e464f96b61a930aa181a092/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987596%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [ayvens.be] INFO: Saving data for 1987596: {'created_time': 1774651539.344869, 'last_price_update_time': 1774651539.344881, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987596') HTTP/1.1" 204 0
2026-03-27 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/9.jpg not downloaded yet
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547c9d0>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/10.jpg saved to cache
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530ea10>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/4.jpg saved to cache
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/10.jpg not downloaded yet
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55edf50>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/6.jpg saved to cache
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560e410>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/5.jpg saved to cache
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:39 [ayvens.be] INFO: Found listing with ID: 1987602
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987602%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [ayvens.be] INFO: Scrape type for 1987602: 1
2026-03-27 22:45:39 [ayvens.be] INFO: Extracting data for car ID: 1987602
2026-03-27 22:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c0e4b1-316e-58d4-8c68-c2787408cc6c with identifier: 1987602
2026-03-27 22:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c with scrape type 1
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/1.jpg not downloaded yet
2026-03-27 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7056bd0>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/7.jpg saved to cache
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/2.jpg not downloaded yet
2026-03-27 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/3.jpg not downloaded yet
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7690>
2026-03-27 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/8.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/4.jpg not downloaded yet
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/5.jpg not downloaded yet
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d3210>
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/9.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d452a950>
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/10.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/6.jpg not downloaded yet
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/7.jpg not downloaded yet
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/8.jpg not downloaded yet
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ba510>
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/8.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531c910>
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F843d2338c4274f10a0d3607548553989%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/9.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-27 22:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f562b3c3-4465-58af-bad1-2ced11145b8e, skipping ID generation
2026-03-27 22:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 1
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f562b3c3-4465-58af-bad1-2ced11145b8e sending to next pipeline
2026-03-27 22:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f562b3c3-4465-58af-bad1-2ced11145b8e, identifier: 1987600
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d8dda990>
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F1927938a84af48e2aea5b1b0024d52c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/7.jpg saved to cache
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-27 22:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4, skipping ID generation
2026-03-27 22:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 1
2026-03-27 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 sending to next pipeline
2026-03-27 22:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4, identifier: 1987595
2026-03-27 22:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1987600
2026-03-27 22:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1987600
2026-03-27 22:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1987600 to the API
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f562b3c3-4465-58af-bad1-2ced11145b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 107173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/843d2338c4274f10a0d3607548553989/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO GT',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO GT',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987600%27 HTTP/1.1" 200 None
2026-03-27 22:45:41 [ayvens.be] INFO: Saving data for 1987600: {'created_time': 1774651541.29144, 'last_price_update_time': 1774651541.291453, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987600') HTTP/1.1" 204 0
2026-03-27 22:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1987595
2026-03-27 22:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1987595
2026-03-27 22:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1987595 to the API
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6235cf64-c13d-5557-9b9a-f84c9caa6fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 105698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 998269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/1927938a84af48e2aea5b1b0024d52c8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987595%27 HTTP/1.1" 200 None
2026-03-27 22:45:41 [ayvens.be] INFO: Saving data for 1987595: {'created_time': 1774651541.667829, 'last_price_update_time': 1774651541.667845, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987595') HTTP/1.1" 204 0
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/9.jpg not downloaded yet
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/10.jpg not downloaded yet
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c1190>
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/2.jpg saved to cache
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d1650>
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/1.jpg saved to cache
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:41 [ayvens.be] INFO: Found listing with ID: 1987603
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987603%27 HTTP/1.1" 200 None
2026-03-27 22:45:41 [ayvens.be] INFO: Scrape type for 1987603: 1
2026-03-27 22:45:41 [ayvens.be] INFO: Extracting data for car ID: 1987603
2026-03-27 22:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83ab2a10-d156-5396-83ab-566d3e03277a with identifier: 1987603
2026-03-27 22:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83ab2a10-d156-5396-83ab-566d3e03277a with scrape type 1
2026-03-27 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/1.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/2.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/3.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/4.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/5.jpg not downloaded yet
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531ecd0>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/7.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/6.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/7.jpg not downloaded yet
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/8.jpg not downloaded yet
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4583950>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/4.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e84d0>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/6.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78b70d0>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/5.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668fd0>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/8.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547df50>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/3.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4583950>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/9.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78b70d0>
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F88022ea7c85041228d90ad5bbeb6f839%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/10.jpg saved to cache
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-27 22:45:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b544de51-e016-5cb2-ad6d-11e0b9f81209, skipping ID generation
2026-03-27 22:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 1
2026-03-27 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b544de51-e016-5cb2-ad6d-11e0b9f81209 sending to next pipeline
2026-03-27 22:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b544de51-e016-5cb2-ad6d-11e0b9f81209, identifier: 1987601
2026-03-27 22:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1987601
2026-03-27 22:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1987601
2026-03-27 22:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1987601 to the API
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b544de51-e016-5cb2-ad6d-11e0b9f81209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 38448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/88022ea7c85041228d90ad5bbeb6f839/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987601%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [ayvens.be] INFO: Saving data for 1987601: {'created_time': 1774651543.395016, 'last_price_update_time': 1774651543.395047, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987601') HTTP/1.1" 204 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/9.jpg not downloaded yet
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/10.jpg not downloaded yet
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78b7ad0>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/1.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1c90>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/4.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4526cd0>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/2.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [ayvens.be] INFO: Found listing with ID: 1987604
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987604%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [ayvens.be] INFO: Scrape type for 1987604: 1
2026-03-27 22:45:43 [ayvens.be] INFO: Extracting data for car ID: 1987604
2026-03-27 22:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with identifier: 1987604
2026-03-27 22:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with scrape type 1
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/1.jpg not downloaded yet
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/2.jpg not downloaded yet
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1a50>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/6.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43ba650>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/3.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541b350>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/7.jpg saved to cache
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/3.jpg not downloaded yet
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d1ad0>
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/5.jpg saved to cache
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/4.jpg not downloaded yet
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534a510>
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/10.jpg saved to cache
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d786b710>
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/8.jpg saved to cache
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45601d0>
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/1.jpg saved to cache
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d0850>
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Fa3ae0fc9cb9748d38c51c17f3c3e8a9c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/9.jpg saved to cache
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c
2026-03-27 22:45:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0c0e4b1-316e-58d4-8c68-c2787408cc6c, skipping ID generation
2026-03-27 22:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c with scrape type 1
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0c0e4b1-316e-58d4-8c68-c2787408cc6c sending to next pipeline
2026-03-27 22:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0c0e4b1-316e-58d4-8c68-c2787408cc6c, identifier: 1987602
2026-03-27 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/5.jpg not downloaded yet
2026-03-27 22:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0c0e4b1-316e-58d4-8c68-c2787408cc6c with identifier: 1987602
2026-03-27 22:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0c0e4b1-316e-58d4-8c68-c2787408cc6c with identifier: 1987602
2026-03-27 22:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0c0e4b1-316e-58d4-8c68-c2787408cc6c with identifier: 1987602 to the API
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b0c0e4b1-316e-58d4-8c68-c2787408cc6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 65932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c0e4b1-316e-58d4-8c68-c2787408cc6c/b0c0e4b1-316e-58d4-8c68-c2787408cc6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/a3ae0fc9cb9748d38c51c17f3c3e8a9c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987602%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [ayvens.be] INFO: Saving data for 1987602: {'created_time': 1774651545.00047, 'last_price_update_time': 1774651545.00048, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987602') HTTP/1.1" 204 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/6.jpg not downloaded yet
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5332810>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/2.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/7.jpg not downloaded yet
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45263d0>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/8.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3a10>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/3.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/8.jpg not downloaded yet
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ea090>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/7.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fc850>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/4.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/9.jpg not downloaded yet
2026-03-27 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/10.jpg not downloaded yet
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384650>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/9.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d722fa10>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/6.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553910>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/10.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4585e10>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F376568d6735046829199b6f0c6990047%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/5.jpg saved to cache
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83ab2a10-d156-5396-83ab-566d3e03277a
2026-03-27 22:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83ab2a10-d156-5396-83ab-566d3e03277a, skipping ID generation
2026-03-27 22:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83ab2a10-d156-5396-83ab-566d3e03277a with scrape type 1
2026-03-27 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83ab2a10-d156-5396-83ab-566d3e03277a sending to next pipeline
2026-03-27 22:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 83ab2a10-d156-5396-83ab-566d3e03277a, identifier: 1987603
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3d90>
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/2.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [ayvens.be] INFO: Found listing with ID: 1987605
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987605%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [ayvens.be] INFO: Scrape type for 1987605: 1
2026-03-27 22:45:46 [ayvens.be] INFO: Extracting data for car ID: 1987605
2026-03-27 22:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2922f56e-103c-5486-baeb-ea111bddfc99 with identifier: 1987605
2026-03-27 22:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2922f56e-103c-5486-baeb-ea111bddfc99 with scrape type 1
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/1.jpg not downloaded yet
2026-03-27 22:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 83ab2a10-d156-5396-83ab-566d3e03277a with identifier: 1987603
2026-03-27 22:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 83ab2a10-d156-5396-83ab-566d3e03277a with identifier: 1987603
2026-03-27 22:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 83ab2a10-d156-5396-83ab-566d3e03277a with identifier: 1987603 to the API
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '83ab2a10-d156-5396-83ab-566d3e03277a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 48319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ab2a10-d156-5396-83ab-566d3e03277a/83ab2a10-d156-5396-83ab-566d3e03277a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/376568d6735046829199b6f0c6990047/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987603%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [ayvens.be] INFO: Saving data for 1987603: {'created_time': 1774651546.446559, 'last_price_update_time': 1774651546.446572, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987603') HTTP/1.1" 204 0
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/2.jpg not downloaded yet
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55cb310>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/1.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5397f50>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/4.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/3.jpg not downloaded yet
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/4.jpg not downloaded yet
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a4d50>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/6.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4560390>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/5.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4599150>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/3.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/5.jpg not downloaded yet
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/6.jpg not downloaded yet
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b4d50>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/7.jpg saved to cache
2026-03-27 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b0a50>
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/8.jpg saved to cache
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/7.jpg not downloaded yet
2026-03-27 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/8.jpg not downloaded yet
2026-03-27 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/9.jpg not downloaded yet
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/10.jpg not downloaded yet
2026-03-27 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:47 [ayvens.be] INFO: Found listing with ID: 1987606
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987606%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [ayvens.be] INFO: Scrape type for 1987606: 1
2026-03-27 22:45:47 [ayvens.be] INFO: Extracting data for car ID: 1987606
2026-03-27 22:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with identifier: 1987606
2026-03-27 22:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with scrape type 1
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/1.jpg not downloaded yet
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/2.jpg not downloaded yet
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564d50>
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/10.jpg saved to cache
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fd710>
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F57975756a49549d4a631046bcc2086eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/9.jpg saved to cache
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6
2026-03-27 22:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ba27500-7911-5eb0-afd1-2870a1e0abd6, skipping ID generation
2026-03-27 22:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with scrape type 1
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ba27500-7911-5eb0-afd1-2870a1e0abd6 sending to next pipeline
2026-03-27 22:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ba27500-7911-5eb0-afd1-2870a1e0abd6, identifier: 1987604
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/3.jpg not downloaded yet
2026-03-27 22:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with identifier: 1987604
2026-03-27 22:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with identifier: 1987604
2026-03-27 22:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ba27500-7911-5eb0-afd1-2870a1e0abd6 with identifier: 1987604 to the API
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5ba27500-7911-5eb0-afd1-2870a1e0abd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 43926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba27500-7911-5eb0-afd1-2870a1e0abd6/5ba27500-7911-5eb0-afd1-2870a1e0abd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/57975756a49549d4a631046bcc2086eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2 TURBO 74KW S-S ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 74KW S-S ELEGANCE',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987604%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [ayvens.be] INFO: Saving data for 1987604: {'created_time': 1774651547.865497, 'last_price_update_time': 1774651547.865507, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987604') HTTP/1.1" 204 0
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/4.jpg not downloaded yet
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4598990>
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/2.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5440b10>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/1.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524490>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/3.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/5.jpg not downloaded yet
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/6.jpg not downloaded yet
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/7.jpg not downloaded yet
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/8.jpg not downloaded yet
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/9.jpg not downloaded yet
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e4510>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/5.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fee90>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/4.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/10.jpg not downloaded yet
2026-03-27 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:48 [ayvens.be] INFO: Found listing with ID: 1987607
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987607%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [ayvens.be] INFO: Scrape type for 1987607: 1
2026-03-27 22:45:48 [ayvens.be] INFO: Extracting data for car ID: 1987607
2026-03-27 22:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504482a4-04a8-5ef6-8921-9910c0f36650 with identifier: 1987607
2026-03-27 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504482a4-04a8-5ef6-8921-9910c0f36650 with scrape type 1
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/1.jpg not downloaded yet
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4551350>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/1.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d537fe50>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/6.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5599e50>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/7.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4583010>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/10.jpg saved to cache
2026-03-27 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5599510>
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/9.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5626ed0>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F2a676519565e4c06b6f0cebdf37b0c86%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/8.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2922f56e-103c-5486-baeb-ea111bddfc99
2026-03-27 22:45:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2922f56e-103c-5486-baeb-ea111bddfc99, skipping ID generation
2026-03-27 22:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2922f56e-103c-5486-baeb-ea111bddfc99 with scrape type 1
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2922f56e-103c-5486-baeb-ea111bddfc99 sending to next pipeline
2026-03-27 22:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2922f56e-103c-5486-baeb-ea111bddfc99, identifier: 1987605
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2922f56e-103c-5486-baeb-ea111bddfc99 with identifier: 1987605
2026-03-27 22:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2922f56e-103c-5486-baeb-ea111bddfc99 with identifier: 1987605
2026-03-27 22:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2922f56e-103c-5486-baeb-ea111bddfc99 with identifier: 1987605 to the API
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2922f56e-103c-5486-baeb-ea111bddfc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MG',
 'model': 'EHS',
 'odometer': 26659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2922f56e-103c-5486-baeb-ea111bddfc99/2922f56e-103c-5486-baeb-ea111bddfc99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/2a676519565e4c06b6f0cebdf37b0c86/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG EHS 1.5T PHEV COMFORT AUTO',
 'transmission': 'automatic',
 'trim': '1.5T PHEV COMFORT AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987605%27 HTTP/1.1" 200 None
2026-03-27 22:45:49 [ayvens.be] INFO: Saving data for 1987605: {'created_time': 1774651549.576045, 'last_price_update_time': 1774651549.576055, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987605') HTTP/1.1" 204 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/2.jpg not downloaded yet
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ad590>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/4.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/3.jpg not downloaded yet
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5555350>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/2.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/4.jpg not downloaded yet
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/5.jpg not downloaded yet
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e58c0950>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/3.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547fd90>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/7.jpg saved to cache
2026-03-27 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5496a10>
2026-03-27 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/5.jpg saved to cache
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c6750>
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/6.jpg saved to cache
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/6.jpg not downloaded yet
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4d07290>
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/8.jpg saved to cache
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d0a50>
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/9.jpg saved to cache
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/7.jpg not downloaded yet
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/8.jpg not downloaded yet
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e8850>
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa48f125d1dd94fc8a20fb8afe623ab45%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/10.jpg saved to cache
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f
2026-03-27 22:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f, skipping ID generation
2026-03-27 22:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with scrape type 1
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84e601c2-81b4-5848-919e-9cc4ad4b7c5f sending to next pipeline
2026-03-27 22:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f, identifier: 1987606
2026-03-27 22:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with identifier: 1987606
2026-03-27 22:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with identifier: 1987606
2026-03-27 22:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84e601c2-81b4-5848-919e-9cc4ad4b7c5f with identifier: 1987606 to the API
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '84e601c2-81b4-5848-919e-9cc4ad4b7c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 97807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e601c2-81b4-5848-919e-9cc4ad4b7c5f/84e601c2-81b4-5848-919e-9cc4ad4b7c5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a48f125d1dd94fc8a20fb8afe623ab45/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987606%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [ayvens.be] INFO: Saving data for 1987606: {'created_time': 1774651550.914675, 'last_price_update_time': 1774651550.914685, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987606') HTTP/1.1" 204 0
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/9.jpg not downloaded yet
2026-03-27 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/10.jpg not downloaded yet
2026-03-27 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:50 [ayvens.be] INFO: Found listing with ID: 1987608
2026-03-27 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987608%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [ayvens.be] INFO: Scrape type for 1987608: 1
2026-03-27 22:45:51 [ayvens.be] INFO: Extracting data for car ID: 1987608
2026-03-27 22:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with identifier: 1987608
2026-03-27 22:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with scrape type 1
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/1.jpg not downloaded yet
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/2.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/3.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/4.jpg not downloaded yet
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ff3d0>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/2.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/5.jpg not downloaded yet
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dcdd0>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/1.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454bc90>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/3.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/6.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/7.jpg not downloaded yet
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4cf8a50>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/6.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a4110>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/4.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531d350>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/5.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/8.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/9.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531e250>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/9.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/10.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [ayvens.be] INFO: Found listing with ID: 1987609
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987609%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [ayvens.be] INFO: Scrape type for 1987609: 1
2026-03-27 22:45:51 [ayvens.be] INFO: Extracting data for car ID: 1987609
2026-03-27 22:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b8d5c4-046a-5771-8cd8-68bd4e33083d with identifier: 1987609
2026-03-27 22:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d with scrape type 1
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/1.jpg not downloaded yet
2026-03-27 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0150>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/1.jpg saved to cache
2026-03-27 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a40d0>
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/10.jpg saved to cache
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c2750>
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/2.jpg saved to cache
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/2.jpg not downloaded yet
2026-03-27 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/3.jpg not downloaded yet
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fe610>
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/7.jpg saved to cache
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549dcd0>
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce8d85afa2dc411891376c051bb56f91%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/8.jpg saved to cache
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 504482a4-04a8-5ef6-8921-9910c0f36650
2026-03-27 22:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 504482a4-04a8-5ef6-8921-9910c0f36650, skipping ID generation
2026-03-27 22:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504482a4-04a8-5ef6-8921-9910c0f36650 with scrape type 1
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 504482a4-04a8-5ef6-8921-9910c0f36650 sending to next pipeline
2026-03-27 22:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 504482a4-04a8-5ef6-8921-9910c0f36650, identifier: 1987607
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4517910>
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/3.jpg saved to cache
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/4.jpg not downloaded yet
2026-03-27 22:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 504482a4-04a8-5ef6-8921-9910c0f36650 with identifier: 1987607
2026-03-27 22:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 504482a4-04a8-5ef6-8921-9910c0f36650 with identifier: 1987607
2026-03-27 22:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 504482a4-04a8-5ef6-8921-9910c0f36650 with identifier: 1987607 to the API
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '504482a4-04a8-5ef6-8921-9910c0f36650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 30686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504482a4-04a8-5ef6-8921-9910c0f36650/504482a4-04a8-5ef6-8921-9910c0f36650_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce8d85afa2dc411891376c051bb56f91/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987607%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [ayvens.be] INFO: Saving data for 1987607: {'created_time': 1774651553.006687, 'last_price_update_time': 1774651553.006697, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987607') HTTP/1.1" 204 0
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/5.jpg not downloaded yet
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d722f8d0>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/4.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5719650>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/5.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/6.jpg not downloaded yet
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/7.jpg not downloaded yet
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c8190>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/6.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/8.jpg not downloaded yet
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/9.jpg not downloaded yet
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316e10>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/7.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564990>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/9.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549c350>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/8.jpg saved to cache
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/10.jpg not downloaded yet
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:53 [ayvens.be] INFO: Found listing with ID: 1987610
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987610%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [ayvens.be] INFO: Scrape type for 1987610: 1
2026-03-27 22:45:53 [ayvens.be] INFO: Extracting data for car ID: 1987610
2026-03-27 22:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1987610
2026-03-27 22:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 with scrape type 1
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/1.jpg not downloaded yet
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5443950>
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ea%252Fd93353d78ec34c5e917639844daadedc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/10.jpg saved to cache
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe
2026-03-27 22:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe, skipping ID generation
2026-03-27 22:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with scrape type 1
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8da49a5-6cbf-58d8-99b0-47bfd781f2fe sending to next pipeline
2026-03-27 22:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe, identifier: 1987608
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c8f10>
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/1.jpg saved to cache
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/2.jpg not downloaded yet
2026-03-27 22:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with identifier: 1987608
2026-03-27 22:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with identifier: 1987608
2026-03-27 22:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8da49a5-6cbf-58d8-99b0-47bfd781f2fe with identifier: 1987608 to the API
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c8da49a5-6cbf-58d8-99b0-47bfd781f2fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 13167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8da49a5-6cbf-58d8-99b0-47bfd781f2fe/c8da49a5-6cbf-58d8-99b0-47bfd781f2fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ea/d93353d78ec34c5e917639844daadedc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987608%27 HTTP/1.1" 200 None
2026-03-27 22:45:54 [ayvens.be] INFO: Saving data for 1987608: {'created_time': 1774651554.66516, 'last_price_update_time': 1774651554.665174, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987608') HTTP/1.1" 204 0
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/3.jpg not downloaded yet
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5496ed0>
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/3.jpg saved to cache
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567ed0>
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/2.jpg saved to cache
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/4.jpg not downloaded yet
2026-03-27 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/5.jpg not downloaded yet
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/6.jpg not downloaded yet
2026-03-27 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/7.jpg not downloaded yet
2026-03-27 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/8.jpg not downloaded yet
2026-03-27 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/9.jpg not downloaded yet
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b0150>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/4.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c9310>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/5.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/10.jpg not downloaded yet
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5584d10>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/7.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e62d0>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/6.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [ayvens.be] INFO: Found listing with ID: 1987611
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987611%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [ayvens.be] INFO: Scrape type for 1987611: 1
2026-03-27 22:45:55 [ayvens.be] INFO: Extracting data for car ID: 1987611
2026-03-27 22:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1987611
2026-03-27 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with scrape type 1
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/1.jpg not downloaded yet
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d5990>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/9.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ccf50>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/8.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5626750>
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F3600d35ee24048bc8b6264202a943f78%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/10.jpg saved to cache
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d
2026-03-27 22:45:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1b8d5c4-046a-5771-8cd8-68bd4e33083d, skipping ID generation
2026-03-27 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d with scrape type 1
2026-03-27 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1b8d5c4-046a-5771-8cd8-68bd4e33083d sending to next pipeline
2026-03-27 22:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1b8d5c4-046a-5771-8cd8-68bd4e33083d, identifier: 1987609
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4150>
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/1.jpg saved to cache
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1b8d5c4-046a-5771-8cd8-68bd4e33083d with identifier: 1987609
2026-03-27 22:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1b8d5c4-046a-5771-8cd8-68bd4e33083d with identifier: 1987609
2026-03-27 22:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1b8d5c4-046a-5771-8cd8-68bd4e33083d with identifier: 1987609 to the API
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c1b8d5c4-046a-5771-8cd8-68bd4e33083d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 65277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b8d5c4-046a-5771-8cd8-68bd4e33083d/c1b8d5c4-046a-5771-8cd8-68bd4e33083d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/3600d35ee24048bc8b6264202a943f78/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987609%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [ayvens.be] INFO: Saving data for 1987609: {'created_time': 1774651556.49537, 'last_price_update_time': 1774651556.49538, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987609') HTTP/1.1" 204 0
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/2.jpg not downloaded yet
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/3.jpg not downloaded yet
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/4.jpg not downloaded yet
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/5.jpg not downloaded yet
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/6.jpg not downloaded yet
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/7.jpg not downloaded yet
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5419d10>
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/2.jpg saved to cache
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/8.jpg not downloaded yet
2026-03-27 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548490>
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/4.jpg saved to cache
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d6690>
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/5.jpg saved to cache
2026-03-27 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4598790>
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/6.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5617dd0>
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/7.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/9.jpg not downloaded yet
2026-03-27 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fcc90>
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/3.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5315090>
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/8.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753da50>
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/9.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/10.jpg not downloaded yet
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458c0d0>
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff89844f9b1304797a433ac066945dfdf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/10.jpg saved to cache
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-27 22:45:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6785017-edfe-5f6c-af6a-3220a9f12ca1, skipping ID generation
2026-03-27 22:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 with scrape type 1
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 sending to next pipeline
2026-03-27 22:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6785017-edfe-5f6c-af6a-3220a9f12ca1, identifier: 1987610
2026-03-27 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:57 [ayvens.be] INFO: Found listing with ID: 1987612
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987612%27 HTTP/1.1" 200 None
2026-03-27 22:45:57 [ayvens.be] INFO: Scrape type for 1987612: 1
2026-03-27 22:45:57 [ayvens.be] INFO: Extracting data for car ID: 1987612
2026-03-27 22:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1987612
2026-03-27 22:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with scrape type 1
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/1.jpg not downloaded yet
2026-03-27 22:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1987610
2026-03-27 22:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1987610
2026-03-27 22:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1987610 to the API
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b6785017-edfe-5f6c-af6a-3220a9f12ca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 82885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f89844f9b1304797a433ac066945dfdf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987610%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [ayvens.be] INFO: Saving data for 1987610: {'created_time': 1774651558.083633, 'last_price_update_time': 1774651558.083646, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987610') HTTP/1.1" 204 0
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45313d0>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/1.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/2.jpg not downloaded yet
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b4e10>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/4.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e8550>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/3.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c0250>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/5.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1ad0>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/6.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/3.jpg not downloaded yet
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/4.jpg not downloaded yet
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b0d50>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/2.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505a10>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/7.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/5.jpg not downloaded yet
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454b510>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/8.jpg saved to cache
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/6.jpg not downloaded yet
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/7.jpg not downloaded yet
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457d510>
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/9.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/8.jpg not downloaded yet
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5726b10>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7821aff2f828443ba28de871ae2e8fe4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/10.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-27 22:45:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 241b61b2-ea2e-57de-ae03-168bc4bf04b7, skipping ID generation
2026-03-27 22:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with scrape type 1
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 sending to next pipeline
2026-03-27 22:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 241b61b2-ea2e-57de-ae03-168bc4bf04b7, identifier: 1987611
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/9.jpg not downloaded yet
2026-03-27 22:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1987611
2026-03-27 22:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1987611
2026-03-27 22:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1987611 to the API
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '241b61b2-ea2e-57de-ae03-168bc4bf04b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 93370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7821aff2f828443ba28de871ae2e8fe4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987611%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [ayvens.be] INFO: Saving data for 1987611: {'created_time': 1774651559.540452, 'last_price_update_time': 1774651559.540462, 'auction_closing_time': 1775115000.0}
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987611') HTTP/1.1" 204 0
2026-03-27 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/10.jpg not downloaded yet
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4d06f50>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/1.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457c190>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/2.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:59 [ayvens.be] INFO: Found listing with ID: 1987613
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987613%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [ayvens.be] INFO: Scrape type for 1987613: 1
2026-03-27 22:45:59 [ayvens.be] INFO: Extracting data for car ID: 1987613
2026-03-27 22:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1987613
2026-03-27 22:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304e62fe-2284-5029-9be9-c718b6fbf14f with scrape type 1
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/1.jpg not downloaded yet
2026-03-27 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/2.jpg not downloaded yet
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53baf90>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/3.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/3.jpg not downloaded yet
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/4.jpg not downloaded yet
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4549290>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/6.jpg saved to cache
2026-03-27 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e6990>
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/5.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5397210>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/4.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/5.jpg not downloaded yet
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/6.jpg not downloaded yet
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4530110>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/7.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/7.jpg not downloaded yet
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/8.jpg not downloaded yet
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7310>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/8.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dca50>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/9.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/9.jpg not downloaded yet
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/10.jpg not downloaded yet
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384d50>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/2.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b1590>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F96c1f73c296245919fd4d2647b05bf7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/10.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-27 22:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd, skipping ID generation
2026-03-27 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with scrape type 1
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd sending to next pipeline
2026-03-27 22:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd, identifier: 1987612
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e3a55f50>
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/1.jpg saved to cache
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:00 [ayvens.be] INFO: Found listing with ID: 1987614
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987614%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [ayvens.be] INFO: Scrape type for 1987614: 1
2026-03-27 22:46:00 [ayvens.be] INFO: Extracting data for car ID: 1987614
2026-03-27 22:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1987614
2026-03-27 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 1
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/1.jpg not downloaded yet
2026-03-27 22:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1987612
2026-03-27 22:46:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1987612
2026-03-27 22:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1987612 to the API
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '0ef9c29c-4908-50f3-871c-d2d1f98c96dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 44650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/96c1f73c296245919fd4d2647b05bf7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 50 KWH ELECTRIQUE E-208 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '50 KWH ELECTRIQUE E-208 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987612%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [ayvens.be] INFO: Saving data for 1987612: {'created_time': 1774651561.452166, 'last_price_update_time': 1774651561.452178, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987612') HTTP/1.1" 204 0
2026-03-27 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/2.jpg not downloaded yet
2026-03-27 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342b90>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/3.jpg saved to cache
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45afbd0>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/5.jpg saved to cache
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/3.jpg not downloaded yet
2026-03-27 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/4.jpg not downloaded yet
2026-03-27 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b98d0>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/6.jpg saved to cache
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ff010>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/4.jpg saved to cache
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/5.jpg not downloaded yet
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/6.jpg not downloaded yet
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4533e10>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/8.jpg saved to cache
2026-03-27 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5442750>
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/7.jpg saved to cache
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504c50>
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/9.jpg saved to cache
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/7.jpg not downloaded yet
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/8.jpg not downloaded yet
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/9.jpg not downloaded yet
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/10.jpg not downloaded yet
2026-03-27 22:46:02 [ayvens.be] INFO: Found listing with ID: 1987615
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987615%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [ayvens.be] INFO: Scrape type for 1987615: 1
2026-03-27 22:46:02 [ayvens.be] INFO: Extracting data for car ID: 1987615
2026-03-27 22:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1987615
2026-03-27 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 1
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/1.jpg not downloaded yet
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/2.jpg not downloaded yet
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753efd0>
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78fdf9bdcbf547d7862fddaa70d8597c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/10.jpg saved to cache
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-27 22:46:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 304e62fe-2284-5029-9be9-c718b6fbf14f, skipping ID generation
2026-03-27 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304e62fe-2284-5029-9be9-c718b6fbf14f with scrape type 1
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 304e62fe-2284-5029-9be9-c718b6fbf14f sending to next pipeline
2026-03-27 22:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 304e62fe-2284-5029-9be9-c718b6fbf14f, identifier: 1987613
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/3.jpg not downloaded yet
2026-03-27 22:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1987613
2026-03-27 22:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1987613
2026-03-27 22:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1987613 to the API
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '304e62fe-2284-5029-9be9-c718b6fbf14f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 64095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78fdf9bdcbf547d7862fddaa70d8597c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987613%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [ayvens.be] INFO: Saving data for 1987613: {'created_time': 1774651562.791847, 'last_price_update_time': 1774651562.79186, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987613') HTTP/1.1" 204 0
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/4.jpg not downloaded yet
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53497d0>
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/1.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bba50>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/2.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45040d0>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/3.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cad10>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/4.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b8f90>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/5.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/5.jpg not downloaded yet
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/6.jpg not downloaded yet
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/7.jpg not downloaded yet
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/8.jpg not downloaded yet
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/9.jpg not downloaded yet
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/10.jpg not downloaded yet
2026-03-27 22:46:03 [ayvens.be] INFO: Found listing with ID: 1987616
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987616%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [ayvens.be] INFO: Scrape type for 1987616: 1
2026-03-27 22:46:03 [ayvens.be] INFO: Extracting data for car ID: 1987616
2026-03-27 22:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1987616
2026-03-27 22:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 1
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/1.jpg not downloaded yet
2026-03-27 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/2.jpg not downloaded yet
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5dd0>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/10.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5386510>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/6.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d8065310>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/7.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384450>
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/8.jpg saved to cache
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/3.jpg not downloaded yet
2026-03-27 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/4.jpg not downloaded yet
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5690c90>
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fe10d879acd9c4b599f4b2613717ca49e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/9.jpg saved to cache
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-27 22:46:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2, skipping ID generation
2026-03-27 22:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 1
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 sending to next pipeline
2026-03-27 22:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2, identifier: 1987614
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe450>
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/1.jpg saved to cache
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ccad0>
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/2.jpg saved to cache
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ce5d0>
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/3.jpg saved to cache
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1987614
2026-03-27 22:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1987614
2026-03-27 22:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1987614 to the API
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '30779306-d801-5b7a-b9b1-8ea1ead4d1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 106736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/e10d879acd9c4b599f4b2613717ca49e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987614%27 HTTP/1.1" 200 None
2026-03-27 22:46:04 [ayvens.be] INFO: Saving data for 1987614: {'created_time': 1774651564.888698, 'last_price_update_time': 1774651564.888708, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987614') HTTP/1.1" 204 0
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/5.jpg not downloaded yet
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/6.jpg not downloaded yet
2026-03-27 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cc450>
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/7.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/7.jpg not downloaded yet
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/8.jpg not downloaded yet
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668950>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/5.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4533950>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/9.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a690>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/4.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eb790>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/10.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547bed0>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/6.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/9.jpg not downloaded yet
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5430490>
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2669f2ee5d145cc93a4c185b3fa4988%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/8.jpg saved to cache
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-27 22:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7f4d39c-835f-57b7-985d-07092ee2af02, skipping ID generation
2026-03-27 22:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 1
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7f4d39c-835f-57b7-985d-07092ee2af02 sending to next pipeline
2026-03-27 22:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7f4d39c-835f-57b7-985d-07092ee2af02, identifier: 1987615
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/10.jpg not downloaded yet
2026-03-27 22:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1987615
2026-03-27 22:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1987615
2026-03-27 22:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1987615 to the API
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b7f4d39c-835f-57b7-985d-07092ee2af02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 56256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2669f2ee5d145cc93a4c185b3fa4988/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987615%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [ayvens.be] INFO: Saving data for 1987615: {'created_time': 1774651566.065674, 'last_price_update_time': 1774651566.065684, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987615') HTTP/1.1" 204 0
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [ayvens.be] INFO: Found listing with ID: 1987617
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987617%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [ayvens.be] INFO: Scrape type for 1987617: 1
2026-03-27 22:46:06 [ayvens.be] INFO: Extracting data for car ID: 1987617
2026-03-27 22:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1987617
2026-03-27 22:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 1
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/1.jpg not downloaded yet
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5487510>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/1.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/2.jpg not downloaded yet
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/3.jpg not downloaded yet
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b89d0>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/5.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/4.jpg not downloaded yet
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8c10>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/2.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5343190>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/4.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4552390>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/6.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505c10>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/3.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/5.jpg not downloaded yet
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/6.jpg not downloaded yet
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45674d0>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/7.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/7.jpg not downloaded yet
2026-03-27 22:46:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 7 pages/min), scraped 22 items (at 22 items/min)
2026-03-27 22:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/8.jpg not downloaded yet
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b5590>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/8.jpg saved to cache
2026-03-27 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557b10>
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/9.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540c350>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/1.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/9.jpg not downloaded yet
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566e810>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F7ffba18ff5e247169e1f4ca2a4b205e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/10.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-27 22:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9, skipping ID generation
2026-03-27 22:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 1
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 sending to next pipeline
2026-03-27 22:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9, identifier: 1987616
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eb550>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/2.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/10.jpg not downloaded yet
2026-03-27 22:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1987616
2026-03-27 22:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1987616
2026-03-27 22:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1987616 to the API
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e4341abc-d20c-5dc4-9c41-96d7b9c25bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 148807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/7ffba18ff5e247169e1f4ca2a4b205e5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 71KWH EQA 250+ AMG LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH EQA 250+ AMG LINE',
 'vin': None,
 'year': 2023}
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987616%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [ayvens.be] INFO: Saving data for 1987616: {'created_time': 1774651567.751916, 'last_price_update_time': 1774651567.751926, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987616') HTTP/1.1" 204 0
2026-03-27 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:07 [ayvens.be] INFO: Found listing with ID: 1987618
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987618%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [ayvens.be] INFO: Scrape type for 1987618: 1
2026-03-27 22:46:07 [ayvens.be] INFO: Extracting data for car ID: 1987618
2026-03-27 22:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0487743-3ba7-5920-a5c0-9842c9bf9e90 with identifier: 1987618
2026-03-27 22:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0487743-3ba7-5920-a5c0-9842c9bf9e90 with scrape type 1
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/1.jpg not downloaded yet
2026-03-27 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566fa90>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/4.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/2.jpg not downloaded yet
2026-03-27 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/3.jpg not downloaded yet
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341d10>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/3.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5718ed0>
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/6.jpg saved to cache
2026-03-27 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/4.jpg not downloaded yet
2026-03-27 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/5.jpg not downloaded yet
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1690>
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/5.jpg saved to cache
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5343490>
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/7.jpg saved to cache
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/6.jpg not downloaded yet
2026-03-27 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/7.jpg not downloaded yet
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524f10>
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/9.jpg saved to cache
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/8.jpg not downloaded yet
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/9.jpg not downloaded yet
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5578190>
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/8.jpg saved to cache
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5615890>
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F3173422a25be41dd850d6b09bcd9fdb1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/10.jpg saved to cache
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-27 22:46:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee1d7014-c475-5bb9-87c3-772c3e34a011, skipping ID generation
2026-03-27 22:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 1
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee1d7014-c475-5bb9-87c3-772c3e34a011 sending to next pipeline
2026-03-27 22:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee1d7014-c475-5bb9-87c3-772c3e34a011, identifier: 1987617
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/10.jpg not downloaded yet
2026-03-27 22:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1987617
2026-03-27 22:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1987617
2026-03-27 22:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1987617 to the API
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ee1d7014-c475-5bb9-87c3-772c3e34a011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 58479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/3173422a25be41dd850d6b09bcd9fdb1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School    Double '
          'Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School    Double Pedal',
 'vin': None,
 'year': 2023}
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987617%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [ayvens.be] INFO: Saving data for 1987617: {'created_time': 1774651569.108663, 'last_price_update_time': 1774651569.108675, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987617') HTTP/1.1" 204 0
2026-03-27 22:46:09 [ayvens.be] INFO: Found listing with ID: 1987619
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987619%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [ayvens.be] INFO: Scrape type for 1987619: 1
2026-03-27 22:46:09 [ayvens.be] INFO: Extracting data for car ID: 1987619
2026-03-27 22:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039a195f-391b-5a9a-9496-978202057100 with identifier: 1987619
2026-03-27 22:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039a195f-391b-5a9a-9496-978202057100 with scrape type 1
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/1.jpg not downloaded yet
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/2.jpg not downloaded yet
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/3.jpg not downloaded yet
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/4.jpg not downloaded yet
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/5.jpg not downloaded yet
2026-03-27 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/6.jpg not downloaded yet
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/7.jpg not downloaded yet
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b7a50>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/1.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547f950>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/2.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/8.jpg not downloaded yet
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566d490>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/3.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/9.jpg not downloaded yet
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b11d0>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/6.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5555450>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/5.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bae50>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/7.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5578b90>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/4.jpg saved to cache
2026-03-27 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b3190>
2026-03-27 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/8.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/10.jpg not downloaded yet
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [ayvens.be] INFO: Found listing with ID: 1987620
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987620%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [ayvens.be] INFO: Scrape type for 1987620: 1
2026-03-27 22:46:10 [ayvens.be] INFO: Extracting data for car ID: 1987620
2026-03-27 22:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with identifier: 1987620
2026-03-27 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with scrape type 1
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/1.jpg not downloaded yet
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/2.jpg not downloaded yet
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/3.jpg not downloaded yet
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/4.jpg not downloaded yet
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/5.jpg not downloaded yet
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4567190>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/10.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/6.jpg not downloaded yet
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/7.jpg not downloaded yet
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4564d50>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F16852fe3957b4a52b1045ccbacbe3c9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/9.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0487743-3ba7-5920-a5c0-9842c9bf9e90
2026-03-27 22:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0487743-3ba7-5920-a5c0-9842c9bf9e90, skipping ID generation
2026-03-27 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0487743-3ba7-5920-a5c0-9842c9bf9e90 with scrape type 1
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0487743-3ba7-5920-a5c0-9842c9bf9e90 sending to next pipeline
2026-03-27 22:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e0487743-3ba7-5920-a5c0-9842c9bf9e90, identifier: 1987618
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342cd0>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/4.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4cf8a50>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/2.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4530750>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/3.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454b490>
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/1.jpg saved to cache
2026-03-27 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/8.jpg not downloaded yet
2026-03-27 22:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e0487743-3ba7-5920-a5c0-9842c9bf9e90 with identifier: 1987618
2026-03-27 22:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e0487743-3ba7-5920-a5c0-9842c9bf9e90 with identifier: 1987618
2026-03-27 22:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e0487743-3ba7-5920-a5c0-9842c9bf9e90 with identifier: 1987618 to the API
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e0487743-3ba7-5920-a5c0-9842c9bf9e90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 95278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0487743-3ba7-5920-a5c0-9842c9bf9e90/e0487743-3ba7-5920-a5c0-9842c9bf9e90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/16852fe3957b4a52b1045ccbacbe3c9f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987618%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [ayvens.be] INFO: Saving data for 1987618: {'created_time': 1774651571.355297, 'last_price_update_time': 1774651571.355307, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987618') HTTP/1.1" 204 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/9.jpg not downloaded yet
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/10.jpg not downloaded yet
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5632250>
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/7.jpg saved to cache
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [ayvens.be] INFO: Found listing with ID: 1987621
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987621%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [ayvens.be] INFO: Scrape type for 1987621: 1
2026-03-27 22:46:11 [ayvens.be] INFO: Extracting data for car ID: 1987621
2026-03-27 22:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 360065cf-922f-5a3d-80cd-78425cefc7cf with identifier: 1987621
2026-03-27 22:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360065cf-922f-5a3d-80cd-78425cefc7cf with scrape type 1
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/1.jpg not downloaded yet
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/2.jpg not downloaded yet
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/3.jpg not downloaded yet
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/4.jpg not downloaded yet
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/5.jpg not downloaded yet
2026-03-27 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4d06f50>
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/10.jpg saved to cache
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a0b10>
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/5.jpg saved to cache
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556350>
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/9.jpg saved to cache
2026-03-27 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eb190>
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/1.jpg saved to cache
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540df90>
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/2.jpg saved to cache
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/6.jpg not downloaded yet
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f4490>
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/8.jpg saved to cache
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54873d0>
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Ff5e5321b4e7240829f4acadde356b4c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/6.jpg saved to cache
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 039a195f-391b-5a9a-9496-978202057100
2026-03-27 22:46:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 039a195f-391b-5a9a-9496-978202057100, skipping ID generation
2026-03-27 22:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039a195f-391b-5a9a-9496-978202057100 with scrape type 1
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 039a195f-391b-5a9a-9496-978202057100 sending to next pipeline
2026-03-27 22:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 039a195f-391b-5a9a-9496-978202057100, identifier: 1987619
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/7.jpg not downloaded yet
2026-03-27 22:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 039a195f-391b-5a9a-9496-978202057100 with identifier: 1987619
2026-03-27 22:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 039a195f-391b-5a9a-9496-978202057100 with identifier: 1987619
2026-03-27 22:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 039a195f-391b-5a9a-9496-978202057100 with identifier: 1987619 to the API
2026-03-27 22:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '039a195f-391b-5a9a-9496-978202057100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 49515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 894592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039a195f-391b-5a9a-9496-978202057100/039a195f-391b-5a9a-9496-978202057100_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/f5e5321b4e7240829f4acadde356b4c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987619%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [ayvens.be] INFO: Saving data for 1987619: {'created_time': 1774651573.428971, 'last_price_update_time': 1774651573.428985, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987619') HTTP/1.1" 204 0
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/8.jpg not downloaded yet
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ec6d0>
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/3.jpg saved to cache
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/9.jpg not downloaded yet
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/10.jpg not downloaded yet
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [ayvens.be] INFO: Found listing with ID: 1987622
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987622%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [ayvens.be] INFO: Scrape type for 1987622: 1
2026-03-27 22:46:13 [ayvens.be] INFO: Extracting data for car ID: 1987622
2026-03-27 22:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with identifier: 1987622
2026-03-27 22:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with scrape type 1
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/1.jpg not downloaded yet
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/2.jpg not downloaded yet
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/3.jpg not downloaded yet
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/4.jpg not downloaded yet
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/5.jpg not downloaded yet
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5479c10>
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/4.jpg saved to cache
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/6.jpg not downloaded yet
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e5710>
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/9.jpg saved to cache
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5443f90>
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/7.jpg saved to cache
2026-03-27 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457da90>
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/5.jpg saved to cache
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/7.jpg not downloaded yet
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/8.jpg not downloaded yet
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547e690>
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/6.jpg saved to cache
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553090>
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/8.jpg saved to cache
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560e690>
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fd0213edd67f34f348f1769fa805a1d2a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/10.jpg saved to cache
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5
2026-03-27 22:46:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 921f81b6-ad4f-5e69-a02a-5275c363d6c5, skipping ID generation
2026-03-27 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with scrape type 1
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 921f81b6-ad4f-5e69-a02a-5275c363d6c5 sending to next pipeline
2026-03-27 22:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 921f81b6-ad4f-5e69-a02a-5275c363d6c5, identifier: 1987620
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d733a150>
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/1.jpg saved to cache
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with identifier: 1987620
2026-03-27 22:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with identifier: 1987620
2026-03-27 22:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 921f81b6-ad4f-5e69-a02a-5275c363d6c5 with identifier: 1987620 to the API
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '921f81b6-ad4f-5e69-a02a-5275c363d6c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 72622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_921f81b6-ad4f-5e69-a02a-5275c363d6c5/921f81b6-ad4f-5e69-a02a-5275c363d6c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/d0213edd67f34f348f1769fa805a1d2a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987620%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [ayvens.be] INFO: Saving data for 1987620: {'created_time': 1774651574.897172, 'last_price_update_time': 1774651574.897182, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987620') HTTP/1.1" 204 0
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/9.jpg not downloaded yet
2026-03-27 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/10.jpg not downloaded yet
2026-03-27 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:14 [ayvens.be] INFO: Found listing with ID: 1987623
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987623%27 HTTP/1.1" 200 None
2026-03-27 22:46:14 [ayvens.be] INFO: Scrape type for 1987623: 1
2026-03-27 22:46:14 [ayvens.be] INFO: Extracting data for car ID: 1987623
2026-03-27 22:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 733c255a-8bdc-5b26-b1fb-9bf17e302322 with identifier: 1987623
2026-03-27 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 733c255a-8bdc-5b26-b1fb-9bf17e302322 with scrape type 1
2026-03-27 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/1.jpg not downloaded yet
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/2.jpg not downloaded yet
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/3.jpg not downloaded yet
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/4.jpg not downloaded yet
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433190>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/9.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45668d0>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/6.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/5.jpg not downloaded yet
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b30d0>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/2.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4529050>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/3.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/6.jpg not downloaded yet
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/7.jpg not downloaded yet
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553690>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/4.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5850>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/5.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458e710>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/8.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af610>
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/7.jpg saved to cache
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/8.jpg not downloaded yet
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/9.jpg not downloaded yet
2026-03-27 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/10.jpg not downloaded yet
2026-03-27 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:16 [ayvens.be] INFO: Found listing with ID: 1987624
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987624%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [ayvens.be] INFO: Scrape type for 1987624: 1
2026-03-27 22:46:16 [ayvens.be] INFO: Extracting data for car ID: 1987624
2026-03-27 22:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with identifier: 1987624
2026-03-27 22:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with scrape type 1
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/1.jpg not downloaded yet
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/2.jpg not downloaded yet
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/3.jpg not downloaded yet
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5c10>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/7.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53428d0>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/5.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4150>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/6.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/4.jpg not downloaded yet
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4587090>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/4.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b4210>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/1.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d8ad4810>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/2.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458d6d0>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/3.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/5.jpg not downloaded yet
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7490>
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fbe66a009d09247238f0a9f6ae5617b91%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/10.jpg saved to cache
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 360065cf-922f-5a3d-80cd-78425cefc7cf
2026-03-27 22:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 360065cf-922f-5a3d-80cd-78425cefc7cf, skipping ID generation
2026-03-27 22:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360065cf-922f-5a3d-80cd-78425cefc7cf with scrape type 1
2026-03-27 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 360065cf-922f-5a3d-80cd-78425cefc7cf sending to next pipeline
2026-03-27 22:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 360065cf-922f-5a3d-80cd-78425cefc7cf, identifier: 1987621
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/6.jpg not downloaded yet
2026-03-27 22:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 360065cf-922f-5a3d-80cd-78425cefc7cf with identifier: 1987621
2026-03-27 22:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 360065cf-922f-5a3d-80cd-78425cefc7cf with identifier: 1987621
2026-03-27 22:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 360065cf-922f-5a3d-80cd-78425cefc7cf with identifier: 1987621 to the API
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '360065cf-922f-5a3d-80cd-78425cefc7cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 81663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360065cf-922f-5a3d-80cd-78425cefc7cf/360065cf-922f-5a3d-80cd-78425cefc7cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/be66a009d09247238f0a9f6ae5617b91/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER+',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987621%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [ayvens.be] INFO: Saving data for 1987621: {'created_time': 1774651577.421435, 'last_price_update_time': 1774651577.421448, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987621') HTTP/1.1" 204 0
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/7.jpg not downloaded yet
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4d50>
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/9.jpg saved to cache
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/8.jpg not downloaded yet
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/9.jpg not downloaded yet
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/10.jpg not downloaded yet
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ffe50>
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/8.jpg saved to cache
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:17 [ayvens.be] INFO: Found listing with ID: 1987625
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987625%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [ayvens.be] INFO: Scrape type for 1987625: 1
2026-03-27 22:46:17 [ayvens.be] INFO: Extracting data for car ID: 1987625
2026-03-27 22:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 103a3762-0fb9-5e15-86fb-1345194e25ed with identifier: 1987625
2026-03-27 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103a3762-0fb9-5e15-86fb-1345194e25ed with scrape type 1
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/1.jpg not downloaded yet
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3950>
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F784b922f184f4334baca84badb2a4004%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/10.jpg saved to cache
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95
2026-03-27 22:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95, skipping ID generation
2026-03-27 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with scrape type 1
2026-03-27 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 sending to next pipeline
2026-03-27 22:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95, identifier: 1987622
2026-03-27 22:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with identifier: 1987622
2026-03-27 22:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with identifier: 1987622
2026-03-27 22:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6c095ad1-cc91-50e9-9d47-4563d4d0ff95 with identifier: 1987622 to the API
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6c095ad1-cc91-50e9-9d47-4563d4d0ff95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 115827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c095ad1-cc91-50e9-9d47-4563d4d0ff95/6c095ad1-cc91-50e9-9d47-4563d4d0ff95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/784b922f184f4334baca84badb2a4004/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987622%27 HTTP/1.1" 200 None
2026-03-27 22:46:18 [ayvens.be] INFO: Saving data for 1987622: {'created_time': 1774651578.318083, 'last_price_update_time': 1774651578.318094, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987622') HTTP/1.1" 204 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/2.jpg not downloaded yet
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c52d0>
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/2.jpg saved to cache
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505350>
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/4.jpg saved to cache
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5396750>
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/3.jpg saved to cache
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497c50>
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/5.jpg saved to cache
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505f50>
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/1.jpg saved to cache
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/3.jpg not downloaded yet
2026-03-27 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/4.jpg not downloaded yet
2026-03-27 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/5.jpg not downloaded yet
2026-03-27 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/6.jpg not downloaded yet
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/7.jpg not downloaded yet
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/8.jpg not downloaded yet
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454b610>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/7.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/9.jpg not downloaded yet
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/10.jpg not downloaded yet
2026-03-27 22:46:19 [ayvens.be] INFO: Found listing with ID: 1987626
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987626%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [ayvens.be] INFO: Scrape type for 1987626: 1
2026-03-27 22:46:19 [ayvens.be] INFO: Extracting data for car ID: 1987626
2026-03-27 22:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1987626
2026-03-27 22:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 1
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/1.jpg not downloaded yet
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4523550>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/8.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56de110>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/9.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4523550>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/10.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56de990>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/2.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15b10>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/1.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5599cd0>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F0189f2e5f2d54fc68b7fe3a3c1f9f0c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/6.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 733c255a-8bdc-5b26-b1fb-9bf17e302322
2026-03-27 22:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 733c255a-8bdc-5b26-b1fb-9bf17e302322, skipping ID generation
2026-03-27 22:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 733c255a-8bdc-5b26-b1fb-9bf17e302322 with scrape type 1
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 733c255a-8bdc-5b26-b1fb-9bf17e302322 sending to next pipeline
2026-03-27 22:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 733c255a-8bdc-5b26-b1fb-9bf17e302322, identifier: 1987623
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56267d0>
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/3.jpg saved to cache
2026-03-27 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 733c255a-8bdc-5b26-b1fb-9bf17e302322 with identifier: 1987623
2026-03-27 22:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 733c255a-8bdc-5b26-b1fb-9bf17e302322 with identifier: 1987623
2026-03-27 22:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 733c255a-8bdc-5b26-b1fb-9bf17e302322 with identifier: 1987623 to the API
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '733c255a-8bdc-5b26-b1fb-9bf17e302322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 104367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_733c255a-8bdc-5b26-b1fb-9bf17e302322/733c255a-8bdc-5b26-b1fb-9bf17e302322_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/0189f2e5f2d54fc68b7fe3a3c1f9f0c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 40 G-TRON S TRONIC BUS.ED. S LINE CNG',
 'transmission': 'automatic',
 'trim': '2.0 40 G-TRON S TRONIC BUS.ED. S LINE CNG',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987623%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [ayvens.be] INFO: Saving data for 1987623: {'created_time': 1774651580.32333, 'last_price_update_time': 1774651580.323339, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987623') HTTP/1.1" 204 0
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/2.jpg not downloaded yet
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/3.jpg not downloaded yet
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/4.jpg not downloaded yet
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/5.jpg not downloaded yet
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/6.jpg not downloaded yet
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/7.jpg not downloaded yet
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553790>
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/5.jpg saved to cache
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/8.jpg not downloaded yet
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/9.jpg not downloaded yet
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/10.jpg not downloaded yet
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fc0d0>
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/4.jpg saved to cache
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5617610>
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/6.jpg saved to cache
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505b90>
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/9.jpg saved to cache
2026-03-27 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af5d0>
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/7.jpg saved to cache
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5565210>
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/1.jpg saved to cache
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:21 [ayvens.be] INFO: Found listing with ID: 1987627
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987627%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [ayvens.be] INFO: Scrape type for 1987627: 1
2026-03-27 22:46:21 [ayvens.be] INFO: Extracting data for car ID: 1987627
2026-03-27 22:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a733d51-e438-5328-b232-89233851d9bd with identifier: 1987627
2026-03-27 22:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a733d51-e438-5328-b232-89233851d9bd with scrape type 1
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/1.jpg not downloaded yet
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/2.jpg not downloaded yet
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4595710>
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/8.jpg saved to cache
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e5590>
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F00200889a08640478a6649fb9f35b811%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/10.jpg saved to cache
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533
2026-03-27 22:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ce32ce-12fa-54b7-8df6-84d00cb3c533, skipping ID generation
2026-03-27 22:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with scrape type 1
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ce32ce-12fa-54b7-8df6-84d00cb3c533 sending to next pipeline
2026-03-27 22:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a1ce32ce-12fa-54b7-8df6-84d00cb3c533, identifier: 1987624
2026-03-27 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/3.jpg not downloaded yet
2026-03-27 22:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with identifier: 1987624
2026-03-27 22:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with identifier: 1987624
2026-03-27 22:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a1ce32ce-12fa-54b7-8df6-84d00cb3c533 with identifier: 1987624 to the API
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a1ce32ce-12fa-54b7-8df6-84d00cb3c533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Tiguan',
 'odometer': 41732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ce32ce-12fa-54b7-8df6-84d00cb3c533/a1ce32ce-12fa-54b7-8df6-84d00cb3c533_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/00200889a08640478a6649fb9f35b811/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Tiguan 1.5 TSI 110KW LIFE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI 110KW LIFE DSG',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987624%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [ayvens.be] INFO: Saving data for 1987624: {'created_time': 1774651581.845357, 'last_price_update_time': 1774651581.845371, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987624') HTTP/1.1" 204 0
2026-03-27 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/4.jpg not downloaded yet
2026-03-27 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/5.jpg not downloaded yet
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557510>
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/2.jpg saved to cache
2026-03-27 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6850>
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/1.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/6.jpg not downloaded yet
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/7.jpg not downloaded yet
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7190>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/4.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c9890>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/3.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cbc50>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/2.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/8.jpg not downloaded yet
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/9.jpg not downloaded yet
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/10.jpg not downloaded yet
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5349f90>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/5.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560f950>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/10.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d3d90>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/9.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:22 [ayvens.be] INFO: Found listing with ID: 1987628
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987628%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [ayvens.be] INFO: Scrape type for 1987628: 1
2026-03-27 22:46:22 [ayvens.be] INFO: Extracting data for car ID: 1987628
2026-03-27 22:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4d6929-baef-5de8-99bc-64adec08a793 with identifier: 1987628
2026-03-27 22:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4d6929-baef-5de8-99bc-64adec08a793 with scrape type 1
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/1.jpg not downloaded yet
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/2.jpg not downloaded yet
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4583ad0>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/4.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d1b10>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/8.jpg saved to cache
2026-03-27 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b8c50>
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/3.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/3.jpg not downloaded yet
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/4.jpg not downloaded yet
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/5.jpg not downloaded yet
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504c50>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/7.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5442c10>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/6.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ce350>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/9.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d79ef2d0>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/10.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/6.jpg not downloaded yet
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/7.jpg not downloaded yet
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fcd50>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/8.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457e350>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F750a328fa5bd4a93b162c6a617b031d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/6.jpg saved to cache
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 103a3762-0fb9-5e15-86fb-1345194e25ed
2026-03-27 22:46:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 103a3762-0fb9-5e15-86fb-1345194e25ed, skipping ID generation
2026-03-27 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103a3762-0fb9-5e15-86fb-1345194e25ed with scrape type 1
2026-03-27 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 103a3762-0fb9-5e15-86fb-1345194e25ed sending to next pipeline
2026-03-27 22:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 103a3762-0fb9-5e15-86fb-1345194e25ed, identifier: 1987625
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fd910>
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/2.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/8.jpg not downloaded yet
2026-03-27 22:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 103a3762-0fb9-5e15-86fb-1345194e25ed with identifier: 1987625
2026-03-27 22:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 103a3762-0fb9-5e15-86fb-1345194e25ed with identifier: 1987625
2026-03-27 22:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 103a3762-0fb9-5e15-86fb-1345194e25ed with identifier: 1987625 to the API
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '103a3762-0fb9-5e15-86fb-1345194e25ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 72222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103a3762-0fb9-5e15-86fb-1345194e25ed/103a3762-0fb9-5e15-86fb-1345194e25ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/750a328fa5bd4a93b162c6a617b031d5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987625%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [ayvens.be] INFO: Saving data for 1987625: {'created_time': 1774651584.384271, 'last_price_update_time': 1774651584.384282, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987625') HTTP/1.1" 204 0
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/9.jpg not downloaded yet
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/10.jpg not downloaded yet
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1390>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/1.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af150>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/7.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547e390>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/5.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5566210>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/3.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541a5d0>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/4.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [ayvens.be] INFO: Found listing with ID: 1987629
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987629%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [ayvens.be] INFO: Scrape type for 1987629: 1
2026-03-27 22:46:24 [ayvens.be] INFO: Extracting data for car ID: 1987629
2026-03-27 22:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c839023d-6616-5e23-983c-75456b7eddce with identifier: 1987629
2026-03-27 22:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c839023d-6616-5e23-983c-75456b7eddce with scrape type 1
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/1.jpg not downloaded yet
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/2.jpg not downloaded yet
2026-03-27 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458d090>
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F13b69dad91934f5882522171ba5cc849%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/5.jpg saved to cache
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-27 22:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2dfeb37-a687-5958-9f0b-f61b0318d841, skipping ID generation
2026-03-27 22:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 1
2026-03-27 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2dfeb37-a687-5958-9f0b-f61b0318d841 sending to next pipeline
2026-03-27 22:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2dfeb37-a687-5958-9f0b-f61b0318d841, identifier: 1987626
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/3.jpg not downloaded yet
2026-03-27 22:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1987626
2026-03-27 22:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1987626
2026-03-27 22:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1987626 to the API
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2dfeb37-a687-5958-9f0b-f61b0318d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 89510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/13b69dad91934f5882522171ba5cc849/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS LINE DCT SH BR',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987626%27 HTTP/1.1" 200 None
2026-03-27 22:46:25 [ayvens.be] INFO: Saving data for 1987626: {'created_time': 1774651585.415326, 'last_price_update_time': 1774651585.415338, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987626') HTTP/1.1" 204 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/4.jpg not downloaded yet
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5461a10>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/10.jpg saved to cache
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547bdd0>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/6.jpg saved to cache
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4549c50>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/7.jpg saved to cache
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8a50>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/8.jpg saved to cache
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548a50>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F768e0634ae314b76b35e08524ce9710e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/9.jpg saved to cache
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a733d51-e438-5328-b232-89233851d9bd
2026-03-27 22:46:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a733d51-e438-5328-b232-89233851d9bd, skipping ID generation
2026-03-27 22:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a733d51-e438-5328-b232-89233851d9bd with scrape type 1
2026-03-27 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a733d51-e438-5328-b232-89233851d9bd sending to next pipeline
2026-03-27 22:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6a733d51-e438-5328-b232-89233851d9bd, identifier: 1987627
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45801d0>
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/2.jpg saved to cache
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56acd50>
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/1.jpg saved to cache
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/5.jpg not downloaded yet
2026-03-27 22:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6a733d51-e438-5328-b232-89233851d9bd with identifier: 1987627
2026-03-27 22:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6a733d51-e438-5328-b232-89233851d9bd with identifier: 1987627
2026-03-27 22:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6a733d51-e438-5328-b232-89233851d9bd with identifier: 1987627 to the API
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6a733d51-e438-5328-b232-89233851d9bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 65647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a733d51-e438-5328-b232-89233851d9bd/6a733d51-e438-5328-b232-89233851d9bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/768e0634ae314b76b35e08524ce9710e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987627%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [ayvens.be] INFO: Saving data for 1987627: {'created_time': 1774651586.535967, 'last_price_update_time': 1774651586.535977, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987627') HTTP/1.1" 204 0
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/6.jpg not downloaded yet
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/7.jpg not downloaded yet
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2350>
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/3.jpg saved to cache
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/8.jpg not downloaded yet
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0410>
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/6.jpg saved to cache
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/9.jpg not downloaded yet
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b2cd0>
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/7.jpg saved to cache
2026-03-27 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d6dd0>
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/10.jpg saved to cache
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a490>
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/8.jpg saved to cache
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433a10>
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/5.jpg saved to cache
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547b5d0>
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/4.jpg saved to cache
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/10.jpg not downloaded yet
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5441490>
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F54fc75d807c047f6b7214474889be7a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/9.jpg saved to cache
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e4d6929-baef-5de8-99bc-64adec08a793
2026-03-27 22:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e4d6929-baef-5de8-99bc-64adec08a793, skipping ID generation
2026-03-27 22:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4d6929-baef-5de8-99bc-64adec08a793 with scrape type 1
2026-03-27 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e4d6929-baef-5de8-99bc-64adec08a793 sending to next pipeline
2026-03-27 22:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e4d6929-baef-5de8-99bc-64adec08a793, identifier: 1987628
2026-03-27 22:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e4d6929-baef-5de8-99bc-64adec08a793 with identifier: 1987628
2026-03-27 22:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e4d6929-baef-5de8-99bc-64adec08a793 with identifier: 1987628
2026-03-27 22:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e4d6929-baef-5de8-99bc-64adec08a793 with identifier: 1987628 to the API
2026-03-27 22:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9e4d6929-baef-5de8-99bc-64adec08a793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 72707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d6929-baef-5de8-99bc-64adec08a793/9e4d6929-baef-5de8-99bc-64adec08a793_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/54fc75d807c047f6b7214474889be7a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987628%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [ayvens.be] INFO: Saving data for 1987628: {'created_time': 1774651588.403108, 'last_price_update_time': 1774651588.40312, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987628') HTTP/1.1" 204 0
2026-03-27 22:46:28 [ayvens.be] INFO: Found listing with ID: 1987630
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987630%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [ayvens.be] INFO: Scrape type for 1987630: 1
2026-03-27 22:46:28 [ayvens.be] INFO: Extracting data for car ID: 1987630
2026-03-27 22:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 208a8914-d641-501e-9beb-b51cc64bbfe7 with identifier: 1987630
2026-03-27 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208a8914-d641-501e-9beb-b51cc64bbfe7 with scrape type 1
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/1.jpg not downloaded yet
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/2.jpg not downloaded yet
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/3.jpg not downloaded yet
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/4.jpg not downloaded yet
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/5.jpg not downloaded yet
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/6.jpg not downloaded yet
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/7.jpg not downloaded yet
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/8.jpg not downloaded yet
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/9.jpg not downloaded yet
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5719b10>
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/2.jpg saved to cache
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d3590>
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/1.jpg saved to cache
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/10.jpg not downloaded yet
2026-03-27 22:46:28 [ayvens.be] INFO: Found listing with ID: 1987631
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987631%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [ayvens.be] INFO: Scrape type for 1987631: 1
2026-03-27 22:46:28 [ayvens.be] INFO: Extracting data for car ID: 1987631
2026-03-27 22:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with identifier: 1987631
2026-03-27 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with scrape type 1
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/1.jpg not downloaded yet
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560fed0>
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/5.jpg saved to cache
2026-03-27 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567fd0>
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/4.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ef3d0>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/3.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5317ed0>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/6.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9050>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/7.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ee0d0>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/8.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/2.jpg not downloaded yet
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/3.jpg not downloaded yet
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524610>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/2.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ecd50>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/1.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/4.jpg not downloaded yet
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/5.jpg not downloaded yet
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/6.jpg not downloaded yet
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56326d0>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/4.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5669010>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/3.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4f50>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/9.jpg saved to cache
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/7.jpg not downloaded yet
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/8.jpg not downloaded yet
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534bb10>
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F6a612c43989a4b72bf2b14517d0348eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/10.jpg saved to cache
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c839023d-6616-5e23-983c-75456b7eddce
2026-03-27 22:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c839023d-6616-5e23-983c-75456b7eddce, skipping ID generation
2026-03-27 22:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c839023d-6616-5e23-983c-75456b7eddce with scrape type 1
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c839023d-6616-5e23-983c-75456b7eddce sending to next pipeline
2026-03-27 22:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c839023d-6616-5e23-983c-75456b7eddce, identifier: 1987629
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d705c4d0>
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/9.jpg saved to cache
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/9.jpg not downloaded yet
2026-03-27 22:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c839023d-6616-5e23-983c-75456b7eddce with identifier: 1987629
2026-03-27 22:46:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c839023d-6616-5e23-983c-75456b7eddce with identifier: 1987629
2026-03-27 22:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c839023d-6616-5e23-983c-75456b7eddce with identifier: 1987629 to the API
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c839023d-6616-5e23-983c-75456b7eddce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK - 2017',
 'odometer': 81245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c839023d-6616-5e23-983c-75456b7eddce/c839023d-6616-5e23-983c-75456b7eddce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/6a612c43989a4b72bf2b14517d0348eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK - 2017 30 TFSI (EU6d-TEMP) STOCK',
 'transmission': 'manual',
 'trim': '30 TFSI (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987629%27 HTTP/1.1" 200 None
2026-03-27 22:46:30 [ayvens.be] INFO: Saving data for 1987629: {'created_time': 1774651590.779717, 'last_price_update_time': 1774651590.779728, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987629') HTTP/1.1" 204 0
2026-03-27 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/10.jpg not downloaded yet
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eba10>
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/8.jpg saved to cache
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a2690>
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/7.jpg saved to cache
2026-03-27 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541fc10>
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/5.jpg saved to cache
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1050>
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/6.jpg saved to cache
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341110>
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F8e635a419cc64db4987f70defab5d531%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/10.jpg saved to cache
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 208a8914-d641-501e-9beb-b51cc64bbfe7
2026-03-27 22:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 208a8914-d641-501e-9beb-b51cc64bbfe7, skipping ID generation
2026-03-27 22:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208a8914-d641-501e-9beb-b51cc64bbfe7 with scrape type 1
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 208a8914-d641-501e-9beb-b51cc64bbfe7 sending to next pipeline
2026-03-27 22:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 208a8914-d641-501e-9beb-b51cc64bbfe7, identifier: 1987630
2026-03-27 22:46:31 [ayvens.be] INFO: Found listing with ID: 1987632
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987632%27 HTTP/1.1" 200 None
2026-03-27 22:46:31 [ayvens.be] INFO: Scrape type for 1987632: 1
2026-03-27 22:46:31 [ayvens.be] INFO: Extracting data for car ID: 1987632
2026-03-27 22:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with identifier: 1987632
2026-03-27 22:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with scrape type 1
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/1.jpg not downloaded yet
2026-03-27 22:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 208a8914-d641-501e-9beb-b51cc64bbfe7 with identifier: 1987630
2026-03-27 22:46:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 208a8914-d641-501e-9beb-b51cc64bbfe7 with identifier: 1987630
2026-03-27 22:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 208a8914-d641-501e-9beb-b51cc64bbfe7 with identifier: 1987630 to the API
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'VESUVIUSGRIJS METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '208a8914-d641-501e-9beb-b51cc64bbfe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 147307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208a8914-d641-501e-9beb-b51cc64bbfe7/208a8914-d641-501e-9beb-b51cc64bbfe7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/8e635a419cc64db4987f70defab5d531/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987630%27 HTTP/1.1" 200 None
2026-03-27 22:46:31 [ayvens.be] INFO: Saving data for 1987630: {'created_time': 1774651591.904329, 'last_price_update_time': 1774651591.90434, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987630') HTTP/1.1" 204 0
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5631c90>
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/2.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/2.jpg not downloaded yet
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/3.jpg not downloaded yet
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/4.jpg not downloaded yet
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/5.jpg not downloaded yet
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/6.jpg not downloaded yet
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/7.jpg not downloaded yet
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/8.jpg not downloaded yet
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45859d0>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/3.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4528810>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/5.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4586a10>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/6.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e010>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/1.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/9.jpg not downloaded yet
2026-03-27 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/10.jpg not downloaded yet
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5250>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/4.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d0b50>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/7.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b1ed0>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/8.jpg saved to cache
2026-03-27 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5485b90>
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/9.jpg saved to cache
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [ayvens.be] INFO: Found listing with ID: 1987633
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987633%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [ayvens.be] INFO: Scrape type for 1987633: 1
2026-03-27 22:46:33 [ayvens.be] INFO: Extracting data for car ID: 1987633
2026-03-27 22:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with identifier: 1987633
2026-03-27 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with scrape type 1
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/1.jpg not downloaded yet
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560ce90>
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/3.jpg saved to cache
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/2.jpg not downloaded yet
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/3.jpg not downloaded yet
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d2f50>
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/2.jpg saved to cache
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d79ef2d0>
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/1.jpg saved to cache
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/4.jpg not downloaded yet
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/5.jpg not downloaded yet
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316ed0>
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F5532a3ccb3714093a85ece78fc6dc481%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/10.jpg saved to cache
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02
2026-03-27 22:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c12ef80b-3425-50f6-88a3-e3b6a5f26c02, skipping ID generation
2026-03-27 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with scrape type 1
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c12ef80b-3425-50f6-88a3-e3b6a5f26c02 sending to next pipeline
2026-03-27 22:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c12ef80b-3425-50f6-88a3-e3b6a5f26c02, identifier: 1987631
2026-03-27 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/6.jpg not downloaded yet
2026-03-27 22:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with identifier: 1987631
2026-03-27 22:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with identifier: 1987631
2026-03-27 22:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c12ef80b-3425-50f6-88a3-e3b6a5f26c02 with identifier: 1987631 to the API
2026-03-27 22:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c12ef80b-3425-50f6-88a3-e3b6a5f26c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 190207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12ef80b-3425-50f6-88a3-e3b6a5f26c02/c12ef80b-3425-50f6-88a3-e3b6a5f26c02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/5532a3ccb3714093a85ece78fc6dc481/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.6 E-TECH HYBRID INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH HYBRID INTENS',
 'vin': None,
 'year': 2021}
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987631%27 HTTP/1.1" 200 None
2026-03-27 22:46:34 [ayvens.be] INFO: Saving data for 1987631: {'created_time': 1774651594.447668, 'last_price_update_time': 1774651594.447679, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987631') HTTP/1.1" 204 0
2026-03-27 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/7.jpg not downloaded yet
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56166d0>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/4.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b9710>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/5.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5659790>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/8.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78ec690>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/9.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5551f50>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/6.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547d350>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/1.jpg saved to cache
2026-03-27 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530d750>
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/7.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/8.jpg not downloaded yet
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/9.jpg not downloaded yet
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457cb10>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Ffcf82d959027495485dfe4b784f40a4b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/10.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1
2026-03-27 22:46:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1, skipping ID generation
2026-03-27 22:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with scrape type 1
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 sending to next pipeline
2026-03-27 22:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1, identifier: 1987632
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/10.jpg not downloaded yet
2026-03-27 22:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with identifier: 1987632
2026-03-27 22:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with identifier: 1987632
2026-03-27 22:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1 with identifier: 1987632 to the API
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 151384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1/f638a3ea-2dd3-5bbc-b7e8-6bb8519f2ef1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/fcf82d959027495485dfe4b784f40a4b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987632%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [ayvens.be] INFO: Saving data for 1987632: {'created_time': 1774651595.646905, 'last_price_update_time': 1774651595.646917, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987632') HTTP/1.1" 204 0
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [ayvens.be] INFO: Found listing with ID: 1987634
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987634%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [ayvens.be] INFO: Scrape type for 1987634: 1
2026-03-27 22:46:35 [ayvens.be] INFO: Extracting data for car ID: 1987634
2026-03-27 22:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with identifier: 1987634
2026-03-27 22:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with scrape type 1
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/1.jpg not downloaded yet
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497d50>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/2.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4586790>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/3.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/2.jpg not downloaded yet
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/3.jpg not downloaded yet
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dd510>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/5.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45aee90>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/4.jpg saved to cache
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/4.jpg not downloaded yet
2026-03-27 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ee310>
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/6.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566a4d0>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/7.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/5.jpg not downloaded yet
2026-03-27 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/6.jpg not downloaded yet
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a0850>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/8.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/7.jpg not downloaded yet
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/8.jpg not downloaded yet
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c9850>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/9.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ec6d0>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/1.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/9.jpg not downloaded yet
2026-03-27 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5dd0>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fedc17b7a0f72470dad081a9ae4776961%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/10.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f
2026-03-27 22:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f, skipping ID generation
2026-03-27 22:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with scrape type 1
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c60fd8c1-7dd9-508c-b628-81f9d1b1d28f sending to next pipeline
2026-03-27 22:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f, identifier: 1987633
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454bd90>
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/2.jpg saved to cache
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/10.jpg not downloaded yet
2026-03-27 22:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with identifier: 1987633
2026-03-27 22:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with identifier: 1987633
2026-03-27 22:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c60fd8c1-7dd9-508c-b628-81f9d1b1d28f with identifier: 1987633 to the API
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c60fd8c1-7dd9-508c-b628-81f9d1b1d28f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 104645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60fd8c1-7dd9-508c-b628-81f9d1b1d28f/c60fd8c1-7dd9-508c-b628-81f9d1b1d28f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/edc17b7a0f72470dad081a9ae4776961/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987633%27 HTTP/1.1" 200 None
2026-03-27 22:46:36 [ayvens.be] INFO: Saving data for 1987633: {'created_time': 1774651596.994899, 'last_price_update_time': 1774651596.994909, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987633') HTTP/1.1" 204 0
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [ayvens.be] INFO: Found listing with ID: 1987635
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987635%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [ayvens.be] INFO: Scrape type for 1987635: 1
2026-03-27 22:46:37 [ayvens.be] INFO: Extracting data for car ID: 1987635
2026-03-27 22:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b42885-29d9-5e99-a6e5-c6e1044a901a with identifier: 1987635
2026-03-27 22:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b42885-29d9-5e99-a6e5-c6e1044a901a with scrape type 1
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/1.jpg not downloaded yet
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5419990>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/4.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/2.jpg not downloaded yet
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548210>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/3.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56df710>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/5.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/3.jpg not downloaded yet
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/4.jpg not downloaded yet
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4532390>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/6.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fd1d0>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/7.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/5.jpg not downloaded yet
2026-03-27 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/6.jpg not downloaded yet
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5579fd0>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/9.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547f5d0>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/8.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/7.jpg not downloaded yet
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/8.jpg not downloaded yet
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4585810>
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa9482a9933a643428b30946590637558%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/10.jpg saved to cache
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15
2026-03-27 22:46:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 354dd64c-5907-5d37-b7eb-5f73a76dbb15, skipping ID generation
2026-03-27 22:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with scrape type 1
2026-03-27 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 354dd64c-5907-5d37-b7eb-5f73a76dbb15 sending to next pipeline
2026-03-27 22:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 354dd64c-5907-5d37-b7eb-5f73a76dbb15, identifier: 1987634
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/9.jpg not downloaded yet
2026-03-27 22:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with identifier: 1987634
2026-03-27 22:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with identifier: 1987634
2026-03-27 22:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 354dd64c-5907-5d37-b7eb-5f73a76dbb15 with identifier: 1987634 to the API
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '354dd64c-5907-5d37-b7eb-5f73a76dbb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 52643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354dd64c-5907-5d37-b7eb-5f73a76dbb15/354dd64c-5907-5d37-b7eb-5f73a76dbb15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a9482a9933a643428b30946590637558/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987634%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [ayvens.be] INFO: Saving data for 1987634: {'created_time': 1774651598.40117, 'last_price_update_time': 1774651598.401181, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987634') HTTP/1.1" 204 0
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/10.jpg not downloaded yet
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56deed0>
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/1.jpg saved to cache
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:38 [ayvens.be] INFO: Found listing with ID: 1987636
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987636%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [ayvens.be] INFO: Scrape type for 1987636: 1
2026-03-27 22:46:38 [ayvens.be] INFO: Extracting data for car ID: 1987636
2026-03-27 22:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with identifier: 1987636
2026-03-27 22:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with scrape type 1
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/1.jpg not downloaded yet
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/2.jpg not downloaded yet
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b10d0>
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/2.jpg saved to cache
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/3.jpg not downloaded yet
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/4.jpg not downloaded yet
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/5.jpg not downloaded yet
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/6.jpg not downloaded yet
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/7.jpg not downloaded yet
2026-03-27 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/8.jpg not downloaded yet
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541a1d0>
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/4.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5586710>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/3.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548850>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/5.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cf710>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/6.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/9.jpg not downloaded yet
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/10.jpg not downloaded yet
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554b190>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/7.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45aec90>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/8.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e6d90>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/9.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [ayvens.be] INFO: Found listing with ID: 1987637
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987637%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [ayvens.be] INFO: Scrape type for 1987637: 1
2026-03-27 22:46:39 [ayvens.be] INFO: Extracting data for car ID: 1987637
2026-03-27 22:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a132a73-738e-5e96-ad4e-477f9adf717d with identifier: 1987637
2026-03-27 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a132a73-738e-5e96-ad4e-477f9adf717d with scrape type 1
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/1.jpg not downloaded yet
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/2.jpg not downloaded yet
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/3.jpg not downloaded yet
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/4.jpg not downloaded yet
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/5.jpg not downloaded yet
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/6.jpg not downloaded yet
2026-03-27 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/7.jpg not downloaded yet
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/8.jpg not downloaded yet
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433590>
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc98541bf25e2455e9fdfc6b6a109c8c2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/10.jpg saved to cache
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9b42885-29d9-5e99-a6e5-c6e1044a901a
2026-03-27 22:46:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b42885-29d9-5e99-a6e5-c6e1044a901a, skipping ID generation
2026-03-27 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b42885-29d9-5e99-a6e5-c6e1044a901a with scrape type 1
2026-03-27 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9b42885-29d9-5e99-a6e5-c6e1044a901a sending to next pipeline
2026-03-27 22:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9b42885-29d9-5e99-a6e5-c6e1044a901a, identifier: 1987635
2026-03-27 22:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9b42885-29d9-5e99-a6e5-c6e1044a901a with identifier: 1987635
2026-03-27 22:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9b42885-29d9-5e99-a6e5-c6e1044a901a with identifier: 1987635
2026-03-27 22:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9b42885-29d9-5e99-a6e5-c6e1044a901a with identifier: 1987635 to the API
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c9b42885-29d9-5e99-a6e5-c6e1044a901a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 121416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b42885-29d9-5e99-a6e5-c6e1044a901a/c9b42885-29d9-5e99-a6e5-c6e1044a901a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c98541bf25e2455e9fdfc6b6a109c8c2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 1.5 BLUEHDI 130 BASTILLE + AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 BASTILLE + AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987635%27 HTTP/1.1" 200 None
2026-03-27 22:46:40 [ayvens.be] INFO: Saving data for 1987635: {'created_time': 1774651600.338902, 'last_price_update_time': 1774651600.338916, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987635') HTTP/1.1" 204 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/9.jpg not downloaded yet
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52de110>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/1.jpg saved to cache
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531cf50>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/5.jpg saved to cache
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c15d0>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/4.jpg saved to cache
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/10.jpg not downloaded yet
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe510>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/2.jpg saved to cache
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e50dc910>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/3.jpg saved to cache
2026-03-27 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d1b50>
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/6.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a9c90>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/7.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:41 [ayvens.be] INFO: Found listing with ID: 1987638
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987638%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [ayvens.be] INFO: Scrape type for 1987638: 1
2026-03-27 22:46:41 [ayvens.be] INFO: Extracting data for car ID: 1987638
2026-03-27 22:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with identifier: 1987638
2026-03-27 22:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with scrape type 1
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/1.jpg not downloaded yet
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/2.jpg not downloaded yet
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/3.jpg not downloaded yet
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/4.jpg not downloaded yet
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/5.jpg not downloaded yet
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/6.jpg not downloaded yet
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/7.jpg not downloaded yet
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5552c10>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/2.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/8.jpg not downloaded yet
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d1010>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/3.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43ba550>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/5.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5485810>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/1.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43bab50>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/4.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/9.jpg not downloaded yet
2026-03-27 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/10.jpg not downloaded yet
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549dc10>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/10.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4581150>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/8.jpg saved to cache
2026-03-27 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384310>
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252Fcec3529d0051454a8f330d8de7a228b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/9.jpg saved to cache
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa
2026-03-27 22:46:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa, skipping ID generation
2026-03-27 22:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with scrape type 1
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dcc25eb-e720-51c1-ba1f-0dae31273aaa sending to next pipeline
2026-03-27 22:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa, identifier: 1987636
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with identifier: 1987636
2026-03-27 22:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with identifier: 1987636
2026-03-27 22:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1dcc25eb-e720-51c1-ba1f-0dae31273aaa with identifier: 1987636 to the API
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1dcc25eb-e720-51c1-ba1f-0dae31273aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 48067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 967914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcc25eb-e720-51c1-ba1f-0dae31273aaa/1dcc25eb-e720-51c1-ba1f-0dae31273aaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 900120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/cec3529d0051454a8f330d8de7a228b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2023}
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987636%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [ayvens.be] INFO: Saving data for 1987636: {'created_time': 1774651602.589584, 'last_price_update_time': 1774651602.589594, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987636') HTTP/1.1" 204 0
2026-03-27 22:46:42 [ayvens.be] INFO: Found listing with ID: 1987639
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987639%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [ayvens.be] INFO: Scrape type for 1987639: 1
2026-03-27 22:46:42 [ayvens.be] INFO: Extracting data for car ID: 1987639
2026-03-27 22:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae98682a-23d8-5d92-a343-6bd3053d0b0f with identifier: 1987639
2026-03-27 22:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae98682a-23d8-5d92-a343-6bd3053d0b0f with scrape type 1
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/1.jpg not downloaded yet
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/2.jpg not downloaded yet
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a6ed0>
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/1.jpg saved to cache
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4550350>
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/3.jpg saved to cache
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4549850>
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/2.jpg saved to cache
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/3.jpg not downloaded yet
2026-03-27 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/4.jpg not downloaded yet
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a8fd0>
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/10.jpg saved to cache
2026-03-27 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fda10>
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/6.jpg saved to cache
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/5.jpg not downloaded yet
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/6.jpg not downloaded yet
2026-03-27 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45803d0>
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/8.jpg saved to cache
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e58d0>
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/9.jpg saved to cache
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4597210>
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/4.jpg saved to cache
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a0a90>
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252F2d05036fc3e446f887482887437559b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/7.jpg saved to cache
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a132a73-738e-5e96-ad4e-477f9adf717d
2026-03-27 22:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a132a73-738e-5e96-ad4e-477f9adf717d, skipping ID generation
2026-03-27 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a132a73-738e-5e96-ad4e-477f9adf717d with scrape type 1
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a132a73-738e-5e96-ad4e-477f9adf717d sending to next pipeline
2026-03-27 22:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a132a73-738e-5e96-ad4e-477f9adf717d, identifier: 1987637
2026-03-27 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/7.jpg not downloaded yet
2026-03-27 22:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a132a73-738e-5e96-ad4e-477f9adf717d with identifier: 1987637
2026-03-27 22:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a132a73-738e-5e96-ad4e-477f9adf717d with identifier: 1987637
2026-03-27 22:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a132a73-738e-5e96-ad4e-477f9adf717d with identifier: 1987637 to the API
2026-03-27 22:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a132a73-738e-5e96-ad4e-477f9adf717d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 83752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a132a73-738e-5e96-ad4e-477f9adf717d/1a132a73-738e-5e96-ad4e-477f9adf717d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/2d05036fc3e446f887482887437559b7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.3 TCE 140 TECHNO',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 TECHNO',
 'vin': None,
 'year': 2023}
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987637%27 HTTP/1.1" 200 None
2026-03-27 22:46:44 [ayvens.be] INFO: Saving data for 1987637: {'created_time': 1774651604.459862, 'last_price_update_time': 1774651604.459873, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987637') HTTP/1.1" 204 0
2026-03-27 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/8.jpg not downloaded yet
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56de1d0>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/9.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b8250>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/8.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ff850>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/1.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5495a10>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/10.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569f810>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/6.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/9.jpg not downloaded yet
2026-03-27 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/10.jpg not downloaded yet
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43ba750>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/7.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459ddd0>
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F7970b9f925fa4011bca7692228fc63b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/5.jpg saved to cache
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b
2026-03-27 22:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b, skipping ID generation
2026-03-27 22:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with scrape type 1
2026-03-27 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b sending to next pipeline
2026-03-27 22:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b, identifier: 1987638
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [ayvens.be] INFO: Found listing with ID: 1987640
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987640%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [ayvens.be] INFO: Scrape type for 1987640: 1
2026-03-27 22:46:45 [ayvens.be] INFO: Extracting data for car ID: 1987640
2026-03-27 22:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with identifier: 1987640
2026-03-27 22:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with scrape type 1
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/1.jpg not downloaded yet
2026-03-27 22:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with identifier: 1987638
2026-03-27 22:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with identifier: 1987638
2026-03-27 22:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 08c56cc3-06ee-582a-a587-bd1bc2f0cc3b with identifier: 1987638 to the API
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '08c56cc3-06ee-582a-a587-bd1bc2f0cc3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 38545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c56cc3-06ee-582a-a587-bd1bc2f0cc3b/08c56cc3-06ee-582a-a587-bd1bc2f0cc3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/7970b9f925fa4011bca7692228fc63b7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987638%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [ayvens.be] INFO: Saving data for 1987638: {'created_time': 1774651605.462709, 'last_price_update_time': 1774651605.462719, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987638') HTTP/1.1" 204 0
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/2.jpg not downloaded yet
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5441e50>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/2.jpg saved to cache
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55efc10>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/3.jpg saved to cache
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459a110>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/4.jpg saved to cache
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459ba50>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/6.jpg saved to cache
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/3.jpg not downloaded yet
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/4.jpg not downloaded yet
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5554fd0>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/5.jpg saved to cache
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/5.jpg not downloaded yet
2026-03-27 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/6.jpg not downloaded yet
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531e490>
2026-03-27 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/8.jpg saved to cache
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e8dd0>
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/7.jpg saved to cache
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/7.jpg not downloaded yet
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5631f50>
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/9.jpg saved to cache
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/8.jpg not downloaded yet
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45321d0>
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gs%252Fcd60194867cf479ba26967fca8b94acb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/10.jpg saved to cache
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae98682a-23d8-5d92-a343-6bd3053d0b0f
2026-03-27 22:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae98682a-23d8-5d92-a343-6bd3053d0b0f, skipping ID generation
2026-03-27 22:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae98682a-23d8-5d92-a343-6bd3053d0b0f with scrape type 1
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae98682a-23d8-5d92-a343-6bd3053d0b0f sending to next pipeline
2026-03-27 22:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ae98682a-23d8-5d92-a343-6bd3053d0b0f, identifier: 1987639
2026-03-27 22:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ae98682a-23d8-5d92-a343-6bd3053d0b0f with identifier: 1987639
2026-03-27 22:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ae98682a-23d8-5d92-a343-6bd3053d0b0f with identifier: 1987639
2026-03-27 22:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ae98682a-23d8-5d92-a343-6bd3053d0b0f with identifier: 1987639 to the API
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ae98682a-23d8-5d92-a343-6bd3053d0b0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 81531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae98682a-23d8-5d92-a343-6bd3053d0b0f/ae98682a-23d8-5d92-a343-6bd3053d0b0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gs/cd60194867cf479ba26967fca8b94acb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987639%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [ayvens.be] INFO: Saving data for 1987639: {'created_time': 1774651606.78173, 'last_price_update_time': 1774651606.781743, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987639') HTTP/1.1" 204 0
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/9.jpg not downloaded yet
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/10.jpg not downloaded yet
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [ayvens.be] INFO: Found listing with ID: 1987641
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987641%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [ayvens.be] INFO: Scrape type for 1987641: 1
2026-03-27 22:46:46 [ayvens.be] INFO: Extracting data for car ID: 1987641
2026-03-27 22:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with identifier: 1987641
2026-03-27 22:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with scrape type 1
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/1.jpg not downloaded yet
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/2.jpg not downloaded yet
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/3.jpg not downloaded yet
2026-03-27 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/4.jpg not downloaded yet
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454b610>
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/1.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/5.jpg not downloaded yet
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55781d0>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/2.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/6.jpg not downloaded yet
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45940d0>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/3.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571bbd0>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/4.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ad110>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/5.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571abd0>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/6.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/7.jpg not downloaded yet
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/8.jpg not downloaded yet
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/9.jpg not downloaded yet
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/10.jpg not downloaded yet
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [ayvens.be] INFO: Found listing with ID: 1987642
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987642%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [ayvens.be] INFO: Scrape type for 1987642: 1
2026-03-27 22:46:47 [ayvens.be] INFO: Extracting data for car ID: 1987642
2026-03-27 22:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065f6d3c-a83c-53d2-85d6-8fba82880a30 with identifier: 1987642
2026-03-27 22:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065f6d3c-a83c-53d2-85d6-8fba82880a30 with scrape type 1
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/1.jpg not downloaded yet
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569f510>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/2.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/2.jpg not downloaded yet
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541c590>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/7.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547f610>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/1.jpg saved to cache
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/3.jpg not downloaded yet
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b4c10>
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/3.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54aa510>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/4.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d2910>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/8.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431050>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/9.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/4.jpg not downloaded yet
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fe1d0>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/5.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d1110>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/6.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/5.jpg not downloaded yet
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1390>
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fb5235b921dee4cd9825cd9dbb3f38121%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/10.jpg saved to cache
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9
2026-03-27 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9, skipping ID generation
2026-03-27 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with scrape type 1
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 sending to next pipeline
2026-03-27 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9, identifier: 1987640
2026-03-27 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/6.jpg not downloaded yet
2026-03-27 22:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with identifier: 1987640
2026-03-27 22:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with identifier: 1987640
2026-03-27 22:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9 with identifier: 1987640 to the API
2026-03-27 22:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 71948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9/0d4f7fb8-63c3-5bd0-bc55-c06eb643bbe9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/b5235b921dee4cd9825cd9dbb3f38121/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 GT',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 GT',
 'vin': None,
 'year': 2023}
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987640%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [ayvens.be] INFO: Saving data for 1987640: {'created_time': 1774651609.207124, 'last_price_update_time': 1774651609.207134, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987640') HTTP/1.1" 204 0
2026-03-27 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/7.jpg not downloaded yet
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ae10>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/8.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ba350>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/7.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457cc90>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/9.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5387510>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/1.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/8.jpg not downloaded yet
2026-03-27 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/9.jpg not downloaded yet
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b6c10>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/2.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/10.jpg not downloaded yet
2026-03-27 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:49 [ayvens.be] INFO: Found listing with ID: 1987643
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987643%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [ayvens.be] INFO: Scrape type for 1987643: 1
2026-03-27 22:46:49 [ayvens.be] INFO: Extracting data for car ID: 1987643
2026-03-27 22:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0580f300-0a94-54fe-8060-027567d7dcf3 with identifier: 1987643
2026-03-27 22:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0580f300-0a94-54fe-8060-027567d7dcf3 with scrape type 1
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/1.jpg not downloaded yet
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4596d50>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F96426052cf4246ff99d510e75dadebd0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/10.jpg saved to cache
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54
2026-03-27 22:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54, skipping ID generation
2026-03-27 22:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with scrape type 1
2026-03-27 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 sending to next pipeline
2026-03-27 22:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54, identifier: 1987641
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53957d0>
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/3.jpg saved to cache
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/2.jpg not downloaded yet
2026-03-27 22:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with identifier: 1987641
2026-03-27 22:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with identifier: 1987641
2026-03-27 22:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c676c1e1-d5ca-51a8-9263-48ddcdc0aa54 with identifier: 1987641 to the API
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c676c1e1-d5ca-51a8-9263-48ddcdc0aa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 58219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c676c1e1-d5ca-51a8-9263-48ddcdc0aa54/c676c1e1-d5ca-51a8-9263-48ddcdc0aa54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/96426052cf4246ff99d510e75dadebd0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987641%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [ayvens.be] INFO: Saving data for 1987641: {'created_time': 1774651610.42581, 'last_price_update_time': 1774651610.42582, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987641') HTTP/1.1" 204 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/3.jpg not downloaded yet
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557b5d0>
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/5.jpg saved to cache
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548690>
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/4.jpg saved to cache
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/4.jpg not downloaded yet
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/5.jpg not downloaded yet
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/6.jpg not downloaded yet
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/7.jpg not downloaded yet
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/8.jpg not downloaded yet
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/9.jpg not downloaded yet
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/10.jpg not downloaded yet
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5426950>
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/7.jpg saved to cache
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e8fd0>
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/6.jpg saved to cache
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:50 [ayvens.be] INFO: Found listing with ID: 1987644
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987644%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [ayvens.be] INFO: Scrape type for 1987644: 1
2026-03-27 22:46:50 [ayvens.be] INFO: Extracting data for car ID: 1987644
2026-03-27 22:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5141765-690e-5674-a517-fef3f267b027 with identifier: 1987644
2026-03-27 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5141765-690e-5674-a517-fef3f267b027 with scrape type 1
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/1.jpg not downloaded yet
2026-03-27 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/2.jpg not downloaded yet
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fd690>
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/8.jpg saved to cache
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5441490>
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/9.jpg saved to cache
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54aa8d0>
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/1.jpg saved to cache
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4596090>
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fee68ab287c8545fab8e24b2a4bd9db06%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/10.jpg saved to cache
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 065f6d3c-a83c-53d2-85d6-8fba82880a30
2026-03-27 22:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 065f6d3c-a83c-53d2-85d6-8fba82880a30, skipping ID generation
2026-03-27 22:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065f6d3c-a83c-53d2-85d6-8fba82880a30 with scrape type 1
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 065f6d3c-a83c-53d2-85d6-8fba82880a30 sending to next pipeline
2026-03-27 22:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 065f6d3c-a83c-53d2-85d6-8fba82880a30, identifier: 1987642
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 065f6d3c-a83c-53d2-85d6-8fba82880a30 with identifier: 1987642
2026-03-27 22:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 065f6d3c-a83c-53d2-85d6-8fba82880a30 with identifier: 1987642
2026-03-27 22:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 065f6d3c-a83c-53d2-85d6-8fba82880a30 with identifier: 1987642 to the API
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '065f6d3c-a83c-53d2-85d6-8fba82880a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 123315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065f6d3c-a83c-53d2-85d6-8fba82880a30/065f6d3c-a83c-53d2-85d6-8fba82880a30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/ee68ab287c8545fab8e24b2a4bd9db06/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 dA sDrive16 AdBlue',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987642%27 HTTP/1.1" 200 None
2026-03-27 22:46:51 [ayvens.be] INFO: Saving data for 1987642: {'created_time': 1774651611.814474, 'last_price_update_time': 1774651611.814483, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987642') HTTP/1.1" 204 0
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/3.jpg not downloaded yet
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/4.jpg not downloaded yet
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e97d0>
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/2.jpg saved to cache
2026-03-27 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ff950>
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/4.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/5.jpg not downloaded yet
2026-03-27 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560e250>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/3.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55effd0>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/8.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5690b10>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/7.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7053390>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/5.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5669f90>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/6.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/6.jpg not downloaded yet
2026-03-27 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/7.jpg not downloaded yet
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5418310>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/10.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5326e90>
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fb727f429c06544099a0557875a5f0b52%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/9.jpg saved to cache
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0580f300-0a94-54fe-8060-027567d7dcf3
2026-03-27 22:46:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0580f300-0a94-54fe-8060-027567d7dcf3, skipping ID generation
2026-03-27 22:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0580f300-0a94-54fe-8060-027567d7dcf3 with scrape type 1
2026-03-27 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0580f300-0a94-54fe-8060-027567d7dcf3 sending to next pipeline
2026-03-27 22:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0580f300-0a94-54fe-8060-027567d7dcf3, identifier: 1987643
2026-03-27 22:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0580f300-0a94-54fe-8060-027567d7dcf3 with identifier: 1987643
2026-03-27 22:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0580f300-0a94-54fe-8060-027567d7dcf3 with identifier: 1987643
2026-03-27 22:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0580f300-0a94-54fe-8060-027567d7dcf3 with identifier: 1987643 to the API
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0580f300-0a94-54fe-8060-027567d7dcf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII VARIANT DIESEL - 2017',
 'odometer': 142797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580f300-0a94-54fe-8060-027567d7dcf3/0580f300-0a94-54fe-8060-027567d7dcf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/b727f429c06544099a0557875a5f0b52/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII VARIANT DIESEL - 2017 1.6 SCR TDi Trendline',
 'transmission': 'manual',
 'trim': '1.6 SCR TDi Trendline',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987643%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [ayvens.be] INFO: Saving data for 1987643: {'created_time': 1774651613.344239, 'last_price_update_time': 1774651613.34425, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987643') HTTP/1.1" 204 0
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/8.jpg not downloaded yet
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a4250>
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/1.jpg saved to cache
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/9.jpg not downloaded yet
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/10.jpg not downloaded yet
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549fb90>
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/2.jpg saved to cache
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dd4d0>
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/3.jpg saved to cache
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:53 [ayvens.be] INFO: Found listing with ID: 1987645
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987645%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [ayvens.be] INFO: Scrape type for 1987645: 1
2026-03-27 22:46:53 [ayvens.be] INFO: Extracting data for car ID: 1987645
2026-03-27 22:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60de4ddf-d511-597d-bd26-3c489ed73688 with identifier: 1987645
2026-03-27 22:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60de4ddf-d511-597d-bd26-3c489ed73688 with scrape type 1
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/1.jpg not downloaded yet
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4549e50>
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/5.jpg saved to cache
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9210>
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/4.jpg saved to cache
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/2.jpg not downloaded yet
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/3.jpg not downloaded yet
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/4.jpg not downloaded yet
2026-03-27 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/5.jpg not downloaded yet
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/6.jpg not downloaded yet
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/7.jpg not downloaded yet
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/8.jpg not downloaded yet
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/9.jpg not downloaded yet
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534aa50>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/6.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459dc10>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/8.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0c10>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/7.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459cd50>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/9.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/10.jpg not downloaded yet
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [ayvens.be] INFO: Found listing with ID: 1987646
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987646%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [ayvens.be] INFO: Scrape type for 1987646: 1
2026-03-27 22:46:54 [ayvens.be] INFO: Extracting data for car ID: 1987646
2026-03-27 22:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e73da34d-9c1a-5fae-aa6b-82791a5344b7 with identifier: 1987646
2026-03-27 22:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73da34d-9c1a-5fae-aa6b-82791a5344b7 with scrape type 1
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/1.jpg not downloaded yet
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459a490>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/1.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/2.jpg not downloaded yet
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/3.jpg not downloaded yet
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5485450>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/2.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56df950>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/3.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/4.jpg not downloaded yet
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/5.jpg not downloaded yet
2026-03-27 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b0210>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/4.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5551250>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/6.jpg saved to cache
2026-03-27 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45872d0>
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/5.jpg saved to cache
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d5790>
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/7.jpg saved to cache
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe2d0>
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wm%252Faa2daddf11724407bd02a48da1a458b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/10.jpg saved to cache
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5141765-690e-5674-a517-fef3f267b027
2026-03-27 22:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5141765-690e-5674-a517-fef3f267b027, skipping ID generation
2026-03-27 22:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5141765-690e-5674-a517-fef3f267b027 with scrape type 1
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5141765-690e-5674-a517-fef3f267b027 sending to next pipeline
2026-03-27 22:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5141765-690e-5674-a517-fef3f267b027, identifier: 1987644
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/6.jpg not downloaded yet
2026-03-27 22:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5141765-690e-5674-a517-fef3f267b027 with identifier: 1987644
2026-03-27 22:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5141765-690e-5674-a517-fef3f267b027 with identifier: 1987644
2026-03-27 22:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5141765-690e-5674-a517-fef3f267b027 with identifier: 1987644 to the API
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e5141765-690e-5674-a517-fef3f267b027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 99521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5141765-690e-5674-a517-fef3f267b027/e5141765-690e-5674-a517-fef3f267b027_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wm/aa2daddf11724407bd02a48da1a458b8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987644%27 HTTP/1.1" 200 None
2026-03-27 22:46:55 [ayvens.be] INFO: Saving data for 1987644: {'created_time': 1774651615.739738, 'last_price_update_time': 1774651615.73975, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987644') HTTP/1.1" 204 0
2026-03-27 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/7.jpg not downloaded yet
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e02d0>
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/8.jpg saved to cache
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/8.jpg not downloaded yet
2026-03-27 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/9.jpg not downloaded yet
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554ab90>
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/10.jpg saved to cache
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5692a90>
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fd7f0ed935b87447984e5d08165734a62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/9.jpg saved to cache
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60de4ddf-d511-597d-bd26-3c489ed73688
2026-03-27 22:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60de4ddf-d511-597d-bd26-3c489ed73688, skipping ID generation
2026-03-27 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60de4ddf-d511-597d-bd26-3c489ed73688 with scrape type 1
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60de4ddf-d511-597d-bd26-3c489ed73688 sending to next pipeline
2026-03-27 22:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60de4ddf-d511-597d-bd26-3c489ed73688, identifier: 1987645
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/10.jpg not downloaded yet
2026-03-27 22:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60de4ddf-d511-597d-bd26-3c489ed73688 with identifier: 1987645
2026-03-27 22:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60de4ddf-d511-597d-bd26-3c489ed73688 with identifier: 1987645
2026-03-27 22:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 60de4ddf-d511-597d-bd26-3c489ed73688 with identifier: 1987645 to the API
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '60de4ddf-d511-597d-bd26-3c489ed73688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 202816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60de4ddf-d511-597d-bd26-3c489ed73688/60de4ddf-d511-597d-bd26-3c489ed73688_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/d7f0ed935b87447984e5d08165734a62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2020}
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987645%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [ayvens.be] INFO: Saving data for 1987645: {'created_time': 1774651616.559395, 'last_price_update_time': 1774651616.55941, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987645') HTTP/1.1" 204 0
2026-03-27 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:56 [ayvens.be] INFO: Found listing with ID: 1987647
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987647%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [ayvens.be] INFO: Scrape type for 1987647: 1
2026-03-27 22:46:56 [ayvens.be] INFO: Extracting data for car ID: 1987647
2026-03-27 22:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8db4242f-c2d2-558f-992b-63a45f7e6c05 with identifier: 1987647
2026-03-27 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8db4242f-c2d2-558f-992b-63a45f7e6c05 with scrape type 1
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/1.jpg not downloaded yet
2026-03-27 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342e90>
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/1.jpg saved to cache
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/2.jpg not downloaded yet
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/3.jpg not downloaded yet
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c1f90>
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/2.jpg saved to cache
2026-03-27 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5693c10>
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/3.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/4.jpg not downloaded yet
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/5.jpg not downloaded yet
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed290>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/4.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/6.jpg not downloaded yet
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/7.jpg not downloaded yet
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d732dc90>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/5.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fc650>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/7.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53159d0>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/6.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/8.jpg not downloaded yet
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/9.jpg not downloaded yet
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7878a90>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/8.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534b010>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/1.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/10.jpg not downloaded yet
2026-03-27 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:57 [ayvens.be] INFO: Found listing with ID: 1987648
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987648%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [ayvens.be] INFO: Scrape type for 1987648: 1
2026-03-27 22:46:57 [ayvens.be] INFO: Extracting data for car ID: 1987648
2026-03-27 22:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c54a87c-fe34-594a-9593-54a851a934c8 with identifier: 1987648
2026-03-27 22:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c54a87c-fe34-594a-9593-54a851a934c8 with scrape type 1
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/1.jpg not downloaded yet
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dfc50>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/10.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564e90>
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fedcc2036f2ae457e8835a0aec18d0c86%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/9.jpg saved to cache
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e73da34d-9c1a-5fae-aa6b-82791a5344b7
2026-03-27 22:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e73da34d-9c1a-5fae-aa6b-82791a5344b7, skipping ID generation
2026-03-27 22:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73da34d-9c1a-5fae-aa6b-82791a5344b7 with scrape type 1
2026-03-27 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e73da34d-9c1a-5fae-aa6b-82791a5344b7 sending to next pipeline
2026-03-27 22:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e73da34d-9c1a-5fae-aa6b-82791a5344b7, identifier: 1987646
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7049810>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/2.jpg saved to cache
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a810>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/4.jpg saved to cache
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a8150>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/3.jpg saved to cache
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/2.jpg not downloaded yet
2026-03-27 22:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e73da34d-9c1a-5fae-aa6b-82791a5344b7 with identifier: 1987646
2026-03-27 22:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e73da34d-9c1a-5fae-aa6b-82791a5344b7 with identifier: 1987646
2026-03-27 22:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e73da34d-9c1a-5fae-aa6b-82791a5344b7 with identifier: 1987646 to the API
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e73da34d-9c1a-5fae-aa6b-82791a5344b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 104968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e73da34d-9c1a-5fae-aa6b-82791a5344b7/e73da34d-9c1a-5fae-aa6b-82791a5344b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/edcc2036f2ae457e8835a0aec18d0c86/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987646%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [ayvens.be] INFO: Saving data for 1987646: {'created_time': 1774651618.555669, 'last_price_update_time': 1774651618.555679, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987646') HTTP/1.1" 204 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/3.jpg not downloaded yet
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b6310>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/5.jpg saved to cache
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/4.jpg not downloaded yet
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/5.jpg not downloaded yet
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/6.jpg not downloaded yet
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/7.jpg not downloaded yet
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/8.jpg not downloaded yet
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45324d0>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/6.jpg saved to cache
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/9.jpg not downloaded yet
2026-03-27 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/10.jpg not downloaded yet
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560d190>
2026-03-27 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/7.jpg saved to cache
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b7a50>
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/8.jpg saved to cache
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55eea90>
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/9.jpg saved to cache
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2e10>
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fe8733f408e13457483dfc1d6fc8e2ebc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/10.jpg saved to cache
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8db4242f-c2d2-558f-992b-63a45f7e6c05
2026-03-27 22:46:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8db4242f-c2d2-558f-992b-63a45f7e6c05, skipping ID generation
2026-03-27 22:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8db4242f-c2d2-558f-992b-63a45f7e6c05 with scrape type 1
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8db4242f-c2d2-558f-992b-63a45f7e6c05 sending to next pipeline
2026-03-27 22:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8db4242f-c2d2-558f-992b-63a45f7e6c05, identifier: 1987647
2026-03-27 22:46:59 [ayvens.be] INFO: Found listing with ID: 1987649
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987649%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [ayvens.be] INFO: Scrape type for 1987649: 1
2026-03-27 22:46:59 [ayvens.be] INFO: Extracting data for car ID: 1987649
2026-03-27 22:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with identifier: 1987649
2026-03-27 22:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with scrape type 1
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/1.jpg not downloaded yet
2026-03-27 22:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8db4242f-c2d2-558f-992b-63a45f7e6c05 with identifier: 1987647
2026-03-27 22:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8db4242f-c2d2-558f-992b-63a45f7e6c05 with identifier: 1987647
2026-03-27 22:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8db4242f-c2d2-558f-992b-63a45f7e6c05 with identifier: 1987647 to the API
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8db4242f-c2d2-558f-992b-63a45f7e6c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 70512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8db4242f-c2d2-558f-992b-63a45f7e6c05/8db4242f-c2d2-558f-992b-63a45f7e6c05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/e8733f408e13457483dfc1d6fc8e2ebc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 180 D BUS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987647%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [ayvens.be] INFO: Saving data for 1987647: {'created_time': 1774651619.704735, 'last_price_update_time': 1774651619.704746, 'auction_closing_time': 1775115000.0}
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987647') HTTP/1.1" 204 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/2.jpg not downloaded yet
2026-03-27 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/3.jpg not downloaded yet
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c2ed0>
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/1.jpg saved to cache
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/4.jpg not downloaded yet
2026-03-27 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/5.jpg not downloaded yet
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56eb210>
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/2.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/6.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/7.jpg not downloaded yet
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f5d10>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/3.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e9bd0>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/5.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53148d0>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/4.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5324d50>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/9.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/8.jpg not downloaded yet
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/9.jpg not downloaded yet
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fc450>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/7.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ea110>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/6.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ad890>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/8.jpg saved to cache
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/10.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [ayvens.be] INFO: Found listing with ID: 1987650
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987650%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [ayvens.be] INFO: Scrape type for 1987650: 1
2026-03-27 22:47:00 [ayvens.be] INFO: Extracting data for car ID: 1987650
2026-03-27 22:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c76b06ab-59e1-51bf-b77e-b79666deb4be with identifier: 1987650
2026-03-27 22:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76b06ab-59e1-51bf-b77e-b79666deb4be with scrape type 1
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/1.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/2.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/3.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/4.jpg not downloaded yet
2026-03-27 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45827d0>
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F341e2df71e8b4834953db135bc068cb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/10.jpg saved to cache
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c54a87c-fe34-594a-9593-54a851a934c8
2026-03-27 22:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c54a87c-fe34-594a-9593-54a851a934c8, skipping ID generation
2026-03-27 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c54a87c-fe34-594a-9593-54a851a934c8 with scrape type 1
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c54a87c-fe34-594a-9593-54a851a934c8 sending to next pipeline
2026-03-27 22:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4c54a87c-fe34-594a-9593-54a851a934c8, identifier: 1987648
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/5.jpg not downloaded yet
2026-03-27 22:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4c54a87c-fe34-594a-9593-54a851a934c8 with identifier: 1987648
2026-03-27 22:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4c54a87c-fe34-594a-9593-54a851a934c8 with identifier: 1987648
2026-03-27 22:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4c54a87c-fe34-594a-9593-54a851a934c8 with identifier: 1987648 to the API
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4c54a87c-fe34-594a-9593-54a851a934c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 150977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c54a87c-fe34-594a-9593-54a851a934c8/4c54a87c-fe34-594a-9593-54a851a934c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/341e2df71e8b4834953db135bc068cb6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 520D 140KW XDRIVE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520D 140KW XDRIVE AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987648%27 HTTP/1.1" 200 None
2026-03-27 22:47:01 [ayvens.be] INFO: Saving data for 1987648: {'created_time': 1774651621.591374, 'last_price_update_time': 1774651621.591384, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987648') HTTP/1.1" 204 0
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/6.jpg not downloaded yet
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c01d0>
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/1.jpg saved to cache
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b18d0>
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/2.jpg saved to cache
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540d410>
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/3.jpg saved to cache
2026-03-27 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c6850>
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/4.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554bf10>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/5.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b3210>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/6.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553f50>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/7.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/7.jpg not downloaded yet
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/8.jpg not downloaded yet
2026-03-27 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/9.jpg not downloaded yet
2026-03-27 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/10.jpg not downloaded yet
2026-03-27 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:02 [ayvens.be] INFO: Found listing with ID: 1987651
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987651%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [ayvens.be] INFO: Scrape type for 1987651: 1
2026-03-27 22:47:02 [ayvens.be] INFO: Extracting data for car ID: 1987651
2026-03-27 22:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with identifier: 1987651
2026-03-27 22:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with scrape type 1
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/1.jpg not downloaded yet
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/2.jpg not downloaded yet
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/3.jpg not downloaded yet
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547d210>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/2.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5626790>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/1.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560ddd0>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/9.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56eac50>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/10.jpg saved to cache
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/4.jpg not downloaded yet
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6850>
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F57783052e2ec4d219421cf26807b963d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/8.jpg saved to cache
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685
2026-03-27 22:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18a17186-45d8-59c1-b1c3-4c68cfb6c685, skipping ID generation
2026-03-27 22:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with scrape type 1
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18a17186-45d8-59c1-b1c3-4c68cfb6c685 sending to next pipeline
2026-03-27 22:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18a17186-45d8-59c1-b1c3-4c68cfb6c685, identifier: 1987649
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/5.jpg not downloaded yet
2026-03-27 22:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with identifier: 1987649
2026-03-27 22:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with identifier: 1987649
2026-03-27 22:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18a17186-45d8-59c1-b1c3-4c68cfb6c685 with identifier: 1987649 to the API
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '18a17186-45d8-59c1-b1c3-4c68cfb6c685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 204930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a17186-45d8-59c1-b1c3-4c68cfb6c685/18a17186-45d8-59c1-b1c3-4c68cfb6c685_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/57783052e2ec4d219421cf26807b963d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 110KW DSG7 L&K',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 L&K',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987649%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [ayvens.be] INFO: Saving data for 1987649: {'created_time': 1774651623.467608, 'last_price_update_time': 1774651623.46762, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987649') HTTP/1.1" 204 0
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/6.jpg not downloaded yet
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/7.jpg not downloaded yet
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fcb50>
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/5.jpg saved to cache
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/8.jpg not downloaded yet
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/9.jpg not downloaded yet
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4562350>
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/3.jpg saved to cache
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5348810>
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/4.jpg saved to cache
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/10.jpg not downloaded yet
2026-03-27 22:47:03 [ayvens.be] INFO: Found listing with ID: 1987652
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987652%27 HTTP/1.1" 200 None
2026-03-27 22:47:04 [ayvens.be] INFO: Scrape type for 1987652: 1
2026-03-27 22:47:04 [ayvens.be] INFO: Extracting data for car ID: 1987652
2026-03-27 22:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b56d8c-6805-5131-8f0d-56c43dca993f with identifier: 1987652
2026-03-27 22:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b56d8c-6805-5131-8f0d-56c43dca993f with scrape type 1
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/1.jpg not downloaded yet
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566bf10>
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/8.jpg saved to cache
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45983d0>
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/7.jpg saved to cache
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5487ed0>
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/6.jpg saved to cache
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547c610>
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/9.jpg saved to cache
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541b390>
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F160a12db5fec4464b69fa724abdebac9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/10.jpg saved to cache
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c76b06ab-59e1-51bf-b77e-b79666deb4be
2026-03-27 22:47:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c76b06ab-59e1-51bf-b77e-b79666deb4be, skipping ID generation
2026-03-27 22:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76b06ab-59e1-51bf-b77e-b79666deb4be with scrape type 1
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c76b06ab-59e1-51bf-b77e-b79666deb4be sending to next pipeline
2026-03-27 22:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c76b06ab-59e1-51bf-b77e-b79666deb4be, identifier: 1987650
2026-03-27 22:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c76b06ab-59e1-51bf-b77e-b79666deb4be with identifier: 1987650
2026-03-27 22:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c76b06ab-59e1-51bf-b77e-b79666deb4be with identifier: 1987650
2026-03-27 22:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c76b06ab-59e1-51bf-b77e-b79666deb4be with identifier: 1987650 to the API
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c76b06ab-59e1-51bf-b77e-b79666deb4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008 DIESEL - 2016',
 'odometer': 69491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76b06ab-59e1-51bf-b77e-b79666deb4be/c76b06ab-59e1-51bf-b77e-b79666deb4be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/160a12db5fec4464b69fa724abdebac9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 DIESEL - 2016 1.5 BlueHDi Active (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987650%27 HTTP/1.1" 200 None
2026-03-27 22:47:04 [ayvens.be] INFO: Saving data for 1987650: {'created_time': 1774651624.956493, 'last_price_update_time': 1774651624.956503, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987650') HTTP/1.1" 204 0
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/2.jpg not downloaded yet
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/3.jpg not downloaded yet
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/4.jpg not downloaded yet
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/5.jpg not downloaded yet
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/6.jpg not downloaded yet
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/7.jpg not downloaded yet
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/8.jpg not downloaded yet
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fe510>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/1.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fcd50>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/3.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/9.jpg not downloaded yet
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/10.jpg not downloaded yet
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e350>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/4.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ac210>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/5.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5326e90>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/2.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45adb10>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/7.jpg saved to cache
2026-03-27 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d3350>
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/8.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540cdd0>
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/6.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:06 [ayvens.be] INFO: Found listing with ID: 1987653
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987653%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [ayvens.be] INFO: Scrape type for 1987653: 1
2026-03-27 22:47:06 [ayvens.be] INFO: Extracting data for car ID: 1987653
2026-03-27 22:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da84af48-b953-530b-9bca-449ba02e47de with identifier: 1987653
2026-03-27 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da84af48-b953-530b-9bca-449ba02e47de with scrape type 1
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/1.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/2.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/3.jpg not downloaded yet
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/4.jpg not downloaded yet
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/5.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/6.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/7.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/8.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/9.jpg not downloaded yet
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/10.jpg not downloaded yet
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b89d0>
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/9.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe5d0>
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/3.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cb5d0>
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F88fb3c5b5f8b48899f3e395472fa1632%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/10.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22
2026-03-27 22:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22, skipping ID generation
2026-03-27 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with scrape type 1
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 sending to next pipeline
2026-03-27 22:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22, identifier: 1987651
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fda50>
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/1.jpg saved to cache
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:06 [ayvens.be] INFO: Found listing with ID: 1987654
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987654%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [ayvens.be] INFO: Scrape type for 1987654: 1
2026-03-27 22:47:06 [ayvens.be] INFO: Extracting data for car ID: 1987654
2026-03-27 22:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c81212d-aac4-5ab1-9503-fbedc482ee12 with identifier: 1987654
2026-03-27 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c81212d-aac4-5ab1-9503-fbedc482ee12 with scrape type 1
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/1.jpg not downloaded yet
2026-03-27 22:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with identifier: 1987651
2026-03-27 22:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with identifier: 1987651
2026-03-27 22:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6eeb6f28-3e7c-5635-a388-d9ec3312ca22 with identifier: 1987651 to the API
2026-03-27 22:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6eeb6f28-3e7c-5635-a388-d9ec3312ca22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORTS',
 'odometer': 102335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eeb6f28-3e7c-5635-a388-d9ec3312ca22/6eeb6f28-3e7c-5635-a388-d9ec3312ca22_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/88fb3c5b5f8b48899f3e395472fa1632/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA TOURING SPORTS 1.8 HYBRID PREMIUM E-CVT',
 'transmission': 'automatic',
 'trim': '1.8 HYBRID PREMIUM E-CVT',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987651%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [ayvens.be] INFO: Saving data for 1987651: {'created_time': 1774651627.22759, 'last_price_update_time': 1774651627.2276, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987651') HTTP/1.1" 204 0
2026-03-27 22:47:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -2 pages/min), scraped 58 items (at 36 items/min)
2026-03-27 22:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5726490>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/2.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5462010>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/5.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d733b390>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/4.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/2.jpg not downloaded yet
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/3.jpg not downloaded yet
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/4.jpg not downloaded yet
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/5.jpg not downloaded yet
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/6.jpg not downloaded yet
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/7.jpg not downloaded yet
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/8.jpg not downloaded yet
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78dfa50>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/8.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/9.jpg not downloaded yet
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c63d0>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/9.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b42d0>
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/7.jpg saved to cache
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/10.jpg not downloaded yet
2026-03-27 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:07 [ayvens.be] INFO: Found listing with ID: 1987655
2026-03-27 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987655%27 HTTP/1.1" 200 None
2026-03-27 22:47:08 [ayvens.be] INFO: Scrape type for 1987655: 1
2026-03-27 22:47:08 [ayvens.be] INFO: Extracting data for car ID: 1987655
2026-03-27 22:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d415cac7-dd78-5aac-99a2-b2cea3c1d00f with identifier: 1987655
2026-03-27 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f with scrape type 1
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/1.jpg not downloaded yet
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54853d0>
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/6.jpg saved to cache
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454a4d0>
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F31d1c9ff3bed473abb957ee22a348d19%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/10.jpg saved to cache
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9b56d8c-6805-5131-8f0d-56c43dca993f
2026-03-27 22:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9b56d8c-6805-5131-8f0d-56c43dca993f, skipping ID generation
2026-03-27 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b56d8c-6805-5131-8f0d-56c43dca993f with scrape type 1
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9b56d8c-6805-5131-8f0d-56c43dca993f sending to next pipeline
2026-03-27 22:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a9b56d8c-6805-5131-8f0d-56c43dca993f, identifier: 1987652
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e18d0>
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/1.jpg saved to cache
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ffb50>
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/2.jpg saved to cache
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5486650>
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/3.jpg saved to cache
2026-03-27 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a9b56d8c-6805-5131-8f0d-56c43dca993f with identifier: 1987652
2026-03-27 22:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a9b56d8c-6805-5131-8f0d-56c43dca993f with identifier: 1987652
2026-03-27 22:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a9b56d8c-6805-5131-8f0d-56c43dca993f with identifier: 1987652 to the API
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a9b56d8c-6805-5131-8f0d-56c43dca993f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 33842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b56d8c-6805-5131-8f0d-56c43dca993f/a9b56d8c-6805-5131-8f0d-56c43dca993f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/31d1c9ff3bed473abb957ee22a348d19/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO 1.0 SCE 65 COMFORT',
 'transmission': 'manual',
 'trim': '1.0 SCE 65 COMFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987652%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [ayvens.be] INFO: Saving data for 1987652: {'created_time': 1774651629.016787, 'last_price_update_time': 1774651629.016797, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987652') HTTP/1.1" 204 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/2.jpg not downloaded yet
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/3.jpg not downloaded yet
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549d50>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/1.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/4.jpg not downloaded yet
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/5.jpg not downloaded yet
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b6a90>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/9.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/6.jpg not downloaded yet
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524d50>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/6.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433ed0>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/10.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/7.jpg not downloaded yet
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553c50>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/4.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4550d10>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/7.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458c850>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/5.jpg saved to cache
2026-03-27 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4528c10>
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Ffb92ebad86f84a4abfdc161f128166d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/8.jpg saved to cache
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da84af48-b953-530b-9bca-449ba02e47de
2026-03-27 22:47:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da84af48-b953-530b-9bca-449ba02e47de, skipping ID generation
2026-03-27 22:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da84af48-b953-530b-9bca-449ba02e47de with scrape type 1
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da84af48-b953-530b-9bca-449ba02e47de sending to next pipeline
2026-03-27 22:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: da84af48-b953-530b-9bca-449ba02e47de, identifier: 1987653
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/8.jpg not downloaded yet
2026-03-27 22:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: da84af48-b953-530b-9bca-449ba02e47de with identifier: 1987653
2026-03-27 22:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: da84af48-b953-530b-9bca-449ba02e47de with identifier: 1987653
2026-03-27 22:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: da84af48-b953-530b-9bca-449ba02e47de with identifier: 1987653 to the API
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'da84af48-b953-530b-9bca-449ba02e47de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 55249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da84af48-b953-530b-9bca-449ba02e47de/da84af48-b953-530b-9bca-449ba02e47de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/fb92ebad86f84a4abfdc161f128166d9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 2.0 TDI 85KW',
 'transmission': 'manual',
 'trim': '2.0 TDI 85KW',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987653%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [ayvens.be] INFO: Saving data for 1987653: {'created_time': 1774651630.641506, 'last_price_update_time': 1774651630.641515, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987653') HTTP/1.1" 204 0
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/9.jpg not downloaded yet
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45514d0>
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/2.jpg saved to cache
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/10.jpg not downloaded yet
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [ayvens.be] INFO: Found listing with ID: 1987656
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987656%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [ayvens.be] INFO: Scrape type for 1987656: 1
2026-03-27 22:47:10 [ayvens.be] INFO: Extracting data for car ID: 1987656
2026-03-27 22:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d168a173-0669-5041-9125-ab385c969bbb with identifier: 1987656
2026-03-27 22:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d168a173-0669-5041-9125-ab385c969bbb with scrape type 1
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/1.jpg not downloaded yet
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/2.jpg not downloaded yet
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/3.jpg not downloaded yet
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/4.jpg not downloaded yet
2026-03-27 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3f10>
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/3.jpg saved to cache
2026-03-27 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5727190>
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/6.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4585290>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/9.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/5.jpg not downloaded yet
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7054bd0>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/10.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458f8d0>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/7.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ea50>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/5.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/6.jpg not downloaded yet
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/7.jpg not downloaded yet
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5494fd0>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/8.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524d50>
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6ceb68c6b8524161b916087c0c34df4f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/4.jpg saved to cache
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c81212d-aac4-5ab1-9503-fbedc482ee12
2026-03-27 22:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c81212d-aac4-5ab1-9503-fbedc482ee12, skipping ID generation
2026-03-27 22:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c81212d-aac4-5ab1-9503-fbedc482ee12 with scrape type 1
2026-03-27 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c81212d-aac4-5ab1-9503-fbedc482ee12 sending to next pipeline
2026-03-27 22:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c81212d-aac4-5ab1-9503-fbedc482ee12, identifier: 1987654
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c81212d-aac4-5ab1-9503-fbedc482ee12 with identifier: 1987654
2026-03-27 22:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c81212d-aac4-5ab1-9503-fbedc482ee12 with identifier: 1987654
2026-03-27 22:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c81212d-aac4-5ab1-9503-fbedc482ee12 with identifier: 1987654 to the API
2026-03-27 22:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2c81212d-aac4-5ab1-9503-fbedc482ee12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 89545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c81212d-aac4-5ab1-9503-fbedc482ee12/2c81212d-aac4-5ab1-9503-fbedc482ee12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6ceb68c6b8524161b916087c0c34df4f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987654%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [ayvens.be] INFO: Saving data for 1987654: {'created_time': 1774651632.122485, 'last_price_update_time': 1774651632.122495, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987654') HTTP/1.1" 204 0
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/8.jpg not downloaded yet
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/9.jpg not downloaded yet
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457d6d0>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/1.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553690>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/3.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53152d0>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/4.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b9550>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/2.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5552750>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/6.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d2a50>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/7.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/10.jpg not downloaded yet
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [ayvens.be] INFO: Found listing with ID: 1987657
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987657%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [ayvens.be] INFO: Scrape type for 1987657: 1
2026-03-27 22:47:12 [ayvens.be] INFO: Extracting data for car ID: 1987657
2026-03-27 22:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with identifier: 1987657
2026-03-27 22:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with scrape type 1
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/1.jpg not downloaded yet
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ff850>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/5.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54aa2d0>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/8.jpg saved to cache
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/2.jpg not downloaded yet
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/3.jpg not downloaded yet
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5578c10>
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/9.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457df90>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/2.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5566310>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/1.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5566450>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F5bf4b9e4cdd44d3b9c5837c88d6c430f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/10.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f
2026-03-27 22:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d415cac7-dd78-5aac-99a2-b2cea3c1d00f, skipping ID generation
2026-03-27 22:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f with scrape type 1
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d415cac7-dd78-5aac-99a2-b2cea3c1d00f sending to next pipeline
2026-03-27 22:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d415cac7-dd78-5aac-99a2-b2cea3c1d00f, identifier: 1987655
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d415cac7-dd78-5aac-99a2-b2cea3c1d00f with identifier: 1987655
2026-03-27 22:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d415cac7-dd78-5aac-99a2-b2cea3c1d00f with identifier: 1987655
2026-03-27 22:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d415cac7-dd78-5aac-99a2-b2cea3c1d00f with identifier: 1987655 to the API
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd415cac7-dd78-5aac-99a2-b2cea3c1d00f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 99535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415cac7-dd78-5aac-99a2-b2cea3c1d00f/d415cac7-dd78-5aac-99a2-b2cea3c1d00f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/5bf4b9e4cdd44d3b9c5837c88d6c430f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 TSI 110 MOVE!',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 MOVE!',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987655%27 HTTP/1.1" 200 None
2026-03-27 22:47:13 [ayvens.be] INFO: Saving data for 1987655: {'created_time': 1774651633.653399, 'last_price_update_time': 1774651633.653408, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987655') HTTP/1.1" 204 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/4.jpg not downloaded yet
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ee390>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/3.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5587810>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/5.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a5e50>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/4.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/5.jpg not downloaded yet
2026-03-27 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7053b10>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/6.jpg saved to cache
2026-03-27 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fd850>
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/7.jpg saved to cache
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/6.jpg not downloaded yet
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5627c10>
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/8.jpg saved to cache
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/7.jpg not downloaded yet
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a7390>
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/9.jpg saved to cache
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548190>
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F8a6c39f917a849aebb85dff82d3838de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/10.jpg saved to cache
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d168a173-0669-5041-9125-ab385c969bbb
2026-03-27 22:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d168a173-0669-5041-9125-ab385c969bbb, skipping ID generation
2026-03-27 22:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d168a173-0669-5041-9125-ab385c969bbb with scrape type 1
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d168a173-0669-5041-9125-ab385c969bbb sending to next pipeline
2026-03-27 22:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d168a173-0669-5041-9125-ab385c969bbb, identifier: 1987656
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4584710>
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/1.jpg saved to cache
2026-03-27 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d168a173-0669-5041-9125-ab385c969bbb with identifier: 1987656
2026-03-27 22:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d168a173-0669-5041-9125-ab385c969bbb with identifier: 1987656
2026-03-27 22:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d168a173-0669-5041-9125-ab385c969bbb with identifier: 1987656 to the API
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd168a173-0669-5041-9125-ab385c969bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 53281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d168a173-0669-5041-9125-ab385c969bbb/d168a173-0669-5041-9125-ab385c969bbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/8a6c39f917a849aebb85dff82d3838de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'transmission': 'automatic',
 'trim': '78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987656%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [ayvens.be] INFO: Saving data for 1987656: {'created_time': 1774651637.762314, 'last_price_update_time': 1774651637.762324, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987656') HTTP/1.1" 204 0
2026-03-27 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/8.jpg not downloaded yet
2026-03-27 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5397b90>
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/2.jpg saved to cache
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/9.jpg not downloaded yet
2026-03-27 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/10.jpg not downloaded yet
2026-03-27 22:47:17 [ayvens.be] INFO: Found listing with ID: 1987658
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987658%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [ayvens.be] INFO: Scrape type for 1987658: 1
2026-03-27 22:47:17 [ayvens.be] INFO: Extracting data for car ID: 1987658
2026-03-27 22:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with identifier: 1987658
2026-03-27 22:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with scrape type 1
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/1.jpg not downloaded yet
2026-03-27 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45048d0>
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/3.jpg saved to cache
2026-03-27 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/2.jpg not downloaded yet
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1090>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/4.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/3.jpg not downloaded yet
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504c10>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/5.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/4.jpg not downloaded yet
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bb350>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/6.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/5.jpg not downloaded yet
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/6.jpg not downloaded yet
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/7.jpg not downloaded yet
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4517f50>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/9.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/8.jpg not downloaded yet
2026-03-27 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/9.jpg not downloaded yet
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566a750>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/7.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0e10>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/8.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2ad0>
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe6ec0f593f9c4fab8a103a0133ab028c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/10.jpg saved to cache
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17
2026-03-27 22:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17, skipping ID generation
2026-03-27 22:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with scrape type 1
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 sending to next pipeline
2026-03-27 22:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17, identifier: 1987657
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/10.jpg not downloaded yet
2026-03-27 22:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with identifier: 1987657
2026-03-27 22:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with identifier: 1987657
2026-03-27 22:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6aa8b48c-5c84-53d1-9f85-aeb91de94a17 with identifier: 1987657 to the API
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6aa8b48c-5c84-53d1-9f85-aeb91de94a17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 60468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa8b48c-5c84-53d1-9f85-aeb91de94a17/6aa8b48c-5c84-53d1-9f85-aeb91de94a17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e6ec0f593f9c4fab8a103a0133ab028c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.2 TURBO 96KW ELEGANCE AUTO',
 'transmission': 'automatic',
 'trim': '1.2 TURBO 96KW ELEGANCE AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987657%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [ayvens.be] INFO: Saving data for 1987657: {'created_time': 1774651639.044841, 'last_price_update_time': 1774651639.044852, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987657') HTTP/1.1" 204 0
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c0f90>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/1.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [ayvens.be] INFO: Found listing with ID: 1987659
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987659%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [ayvens.be] INFO: Scrape type for 1987659: 1
2026-03-27 22:47:19 [ayvens.be] INFO: Extracting data for car ID: 1987659
2026-03-27 22:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584fc82f-8213-5347-a0d9-3e5358a78271 with identifier: 1987659
2026-03-27 22:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584fc82f-8213-5347-a0d9-3e5358a78271 with scrape type 1
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/1.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d741ef10>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/2.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/2.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/3.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557f90>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/3.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/4.jpg not downloaded yet
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/5.jpg not downloaded yet
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bfdd0>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/5.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b1110>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/4.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e750>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/7.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457d490>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/6.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4562490>
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/8.jpg saved to cache
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/6.jpg not downloaded yet
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/7.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/8.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/9.jpg not downloaded yet
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/10.jpg not downloaded yet
2026-03-27 22:47:19 [ayvens.be] INFO: Found listing with ID: 1987660
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987660%27 HTTP/1.1" 200 None
2026-03-27 22:47:19 [ayvens.be] INFO: Scrape type for 1987660: 1
2026-03-27 22:47:19 [ayvens.be] INFO: Extracting data for car ID: 1987660
2026-03-27 22:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fee39eab-9ae0-5d78-9884-9afe25dd46d2 with identifier: 1987660
2026-03-27 22:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee39eab-9ae0-5d78-9884-9afe25dd46d2 with scrape type 1
2026-03-27 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/1.jpg not downloaded yet
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/2.jpg not downloaded yet
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5551550>
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/10.jpg saved to cache
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5590>
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/1.jpg saved to cache
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ff410>
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F6038570305c04c728edfe3f6f7383e11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/9.jpg saved to cache
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac
2026-03-27 22:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac, skipping ID generation
2026-03-27 22:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with scrape type 1
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac sending to next pipeline
2026-03-27 22:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac, identifier: 1987658
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45afb90>
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/2.jpg saved to cache
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a090>
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/3.jpg saved to cache
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/3.jpg not downloaded yet
2026-03-27 22:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with identifier: 1987658
2026-03-27 22:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with identifier: 1987658
2026-03-27 22:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac with identifier: 1987658 to the API
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 209182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac/82e2f98e-0d4d-5ea0-812d-3526b7b0d4ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/6038570305c04c728edfe3f6f7383e11/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987658%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [ayvens.be] INFO: Saving data for 1987658: {'created_time': 1774651641.111179, 'last_price_update_time': 1774651641.11119, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987658') HTTP/1.1" 204 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/4.jpg not downloaded yet
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/5.jpg not downloaded yet
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b1190>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/4.jpg saved to cache
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/6.jpg not downloaded yet
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/7.jpg not downloaded yet
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/8.jpg not downloaded yet
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/9.jpg not downloaded yet
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/10.jpg not downloaded yet
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5990>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/5.jpg saved to cache
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cc990>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/7.jpg saved to cache
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:21 [ayvens.be] INFO: Found listing with ID: 1987661
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987661%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [ayvens.be] INFO: Scrape type for 1987661: 1
2026-03-27 22:47:21 [ayvens.be] INFO: Extracting data for car ID: 1987661
2026-03-27 22:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdaba590-8c24-5a0e-8655-aac4ade3cd38 with identifier: 1987661
2026-03-27 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdaba590-8c24-5a0e-8655-aac4ade3cd38 with scrape type 1
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/1.jpg not downloaded yet
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/2.jpg not downloaded yet
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e24d0>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/6.jpg saved to cache
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7054b10>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/8.jpg saved to cache
2026-03-27 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dc890>
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/10.jpg saved to cache
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459b350>
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F68e8505021e548c5b6e929a4560426a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/9.jpg saved to cache
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 584fc82f-8213-5347-a0d9-3e5358a78271
2026-03-27 22:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 584fc82f-8213-5347-a0d9-3e5358a78271, skipping ID generation
2026-03-27 22:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584fc82f-8213-5347-a0d9-3e5358a78271 with scrape type 1
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 584fc82f-8213-5347-a0d9-3e5358a78271 sending to next pipeline
2026-03-27 22:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 584fc82f-8213-5347-a0d9-3e5358a78271, identifier: 1987659
2026-03-27 22:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 584fc82f-8213-5347-a0d9-3e5358a78271 with identifier: 1987659
2026-03-27 22:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 584fc82f-8213-5347-a0d9-3e5358a78271 with identifier: 1987659
2026-03-27 22:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 584fc82f-8213-5347-a0d9-3e5358a78271 with identifier: 1987659 to the API
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '584fc82f-8213-5347-a0d9-3e5358a78271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 200194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584fc82f-8213-5347-a0d9-3e5358a78271/584fc82f-8213-5347-a0d9-3e5358a78271_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/68e8505021e548c5b6e929a4560426a7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 110KW LIFE DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW LIFE DSG',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987659%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [ayvens.be] INFO: Saving data for 1987659: {'created_time': 1774651642.592208, 'last_price_update_time': 1774651642.59222, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987659') HTTP/1.1" 204 0
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/3.jpg not downloaded yet
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5317ad0>
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/1.jpg saved to cache
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ba610>
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/2.jpg saved to cache
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/4.jpg not downloaded yet
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/5.jpg not downloaded yet
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/6.jpg not downloaded yet
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/7.jpg not downloaded yet
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/8.jpg not downloaded yet
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/9.jpg not downloaded yet
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/10.jpg not downloaded yet
2026-03-27 22:47:22 [ayvens.be] INFO: Found listing with ID: 1987662
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987662%27 HTTP/1.1" 200 None
2026-03-27 22:47:22 [ayvens.be] INFO: Scrape type for 1987662: 1
2026-03-27 22:47:22 [ayvens.be] INFO: Extracting data for car ID: 1987662
2026-03-27 22:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c9774cd-8e8d-541f-960a-6184b74481a8 with identifier: 1987662
2026-03-27 22:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c9774cd-8e8d-541f-960a-6184b74481a8 with scrape type 1
2026-03-27 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/1.jpg not downloaded yet
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cacd0>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/4.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5e50>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/5.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fd4d0>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/6.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549d190>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/7.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ff0d0>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/1.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/2.jpg not downloaded yet
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567690>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/3.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e390>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/8.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fe2d0>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/9.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/3.jpg not downloaded yet
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/4.jpg not downloaded yet
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c66d0>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/2.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/5.jpg not downloaded yet
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/6.jpg not downloaded yet
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540f650>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/3.jpg saved to cache
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/7.jpg not downloaded yet
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/8.jpg not downloaded yet
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dca90>
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/4.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ec810>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/6.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457cc90>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/7.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4594ad0>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/5.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/9.jpg not downloaded yet
2026-03-27 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/10.jpg not downloaded yet
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457c090>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/9.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5010>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/10.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433310>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/1.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fe010>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Ff0b96edb90714b099907291098bbb48c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/10.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fee39eab-9ae0-5d78-9884-9afe25dd46d2
2026-03-27 22:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fee39eab-9ae0-5d78-9884-9afe25dd46d2, skipping ID generation
2026-03-27 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee39eab-9ae0-5d78-9884-9afe25dd46d2 with scrape type 1
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fee39eab-9ae0-5d78-9884-9afe25dd46d2 sending to next pipeline
2026-03-27 22:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fee39eab-9ae0-5d78-9884-9afe25dd46d2, identifier: 1987660
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5367e10>
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/2.jpg saved to cache
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:24 [ayvens.be] INFO: Found listing with ID: 1987663
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987663%27 HTTP/1.1" 200 None
2026-03-27 22:47:24 [ayvens.be] INFO: Scrape type for 1987663: 1
2026-03-27 22:47:24 [ayvens.be] INFO: Extracting data for car ID: 1987663
2026-03-27 22:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c71daee-9be4-5b33-9ee8-5781119bc903 with identifier: 1987663
2026-03-27 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c71daee-9be4-5b33-9ee8-5781119bc903 with scrape type 1
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/1.jpg not downloaded yet
2026-03-27 22:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fee39eab-9ae0-5d78-9884-9afe25dd46d2 with identifier: 1987660
2026-03-27 22:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fee39eab-9ae0-5d78-9884-9afe25dd46d2 with identifier: 1987660
2026-03-27 22:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fee39eab-9ae0-5d78-9884-9afe25dd46d2 with identifier: 1987660 to the API
2026-03-27 22:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fee39eab-9ae0-5d78-9884-9afe25dd46d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 174397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee39eab-9ae0-5d78-9884-9afe25dd46d2/fee39eab-9ae0-5d78-9884-9afe25dd46d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/f0b96edb90714b099907291098bbb48c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRONIC SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987660%27 HTTP/1.1" 200 None
2026-03-27 22:47:25 [ayvens.be] INFO: Saving data for 1987660: {'created_time': 1774651645.188308, 'last_price_update_time': 1774651645.188318, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987660') HTTP/1.1" 204 0
2026-03-27 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/2.jpg not downloaded yet
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e3746550>
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fa4814298030e441fac82cc8fdacaf808%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/8.jpg saved to cache
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdaba590-8c24-5a0e-8655-aac4ade3cd38
2026-03-27 22:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdaba590-8c24-5a0e-8655-aac4ade3cd38, skipping ID generation
2026-03-27 22:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdaba590-8c24-5a0e-8655-aac4ade3cd38 with scrape type 1
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdaba590-8c24-5a0e-8655-aac4ade3cd38 sending to next pipeline
2026-03-27 22:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cdaba590-8c24-5a0e-8655-aac4ade3cd38, identifier: 1987661
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e01d0>
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/3.jpg saved to cache
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/3.jpg not downloaded yet
2026-03-27 22:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cdaba590-8c24-5a0e-8655-aac4ade3cd38 with identifier: 1987661
2026-03-27 22:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cdaba590-8c24-5a0e-8655-aac4ade3cd38 with identifier: 1987661
2026-03-27 22:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cdaba590-8c24-5a0e-8655-aac4ade3cd38 with identifier: 1987661 to the API
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cdaba590-8c24-5a0e-8655-aac4ade3cd38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 154183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaba590-8c24-5a0e-8655-aac4ade3cd38/cdaba590-8c24-5a0e-8655-aac4ade3cd38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/a4814298030e441fac82cc8fdacaf808/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987661%27 HTTP/1.1" 200 None
2026-03-27 22:47:25 [ayvens.be] INFO: Saving data for 1987661: {'created_time': 1774651645.886745, 'last_price_update_time': 1774651645.886755, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987661') HTTP/1.1" 204 0
2026-03-27 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/4.jpg not downloaded yet
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5631910>
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/5.jpg saved to cache
2026-03-27 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531f510>
2026-03-27 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/4.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bb2d0>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/6.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/5.jpg not downloaded yet
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/6.jpg not downloaded yet
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557a750>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/8.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4550b10>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/7.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/7.jpg not downloaded yet
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567190>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/10.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571a4d0>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F310e8043f8944ee7be98843b9318b0d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/9.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c9774cd-8e8d-541f-960a-6184b74481a8
2026-03-27 22:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c9774cd-8e8d-541f-960a-6184b74481a8, skipping ID generation
2026-03-27 22:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c9774cd-8e8d-541f-960a-6184b74481a8 with scrape type 1
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c9774cd-8e8d-541f-960a-6184b74481a8 sending to next pipeline
2026-03-27 22:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c9774cd-8e8d-541f-960a-6184b74481a8, identifier: 1987662
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/8.jpg not downloaded yet
2026-03-27 22:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c9774cd-8e8d-541f-960a-6184b74481a8 with identifier: 1987662
2026-03-27 22:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c9774cd-8e8d-541f-960a-6184b74481a8 with identifier: 1987662
2026-03-27 22:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c9774cd-8e8d-541f-960a-6184b74481a8 with identifier: 1987662 to the API
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c9774cd-8e8d-541f-960a-6184b74481a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN - 2015',
 'odometer': 135954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c9774cd-8e8d-541f-960a-6184b74481a8/3c9774cd-8e8d-541f-960a-6184b74481a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/310e8043f8944ee7be98843b9318b0d1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN - 2015 1.5 TSI ACT Highline OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Highline OPF DSG',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987662%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [ayvens.be] INFO: Saving data for 1987662: {'created_time': 1774651646.891119, 'last_price_update_time': 1774651646.891128, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987662') HTTP/1.1" 204 0
2026-03-27 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/9.jpg not downloaded yet
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4562f50>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/2.jpg saved to cache
2026-03-27 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4562750>
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/1.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/10.jpg not downloaded yet
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [ayvens.be] INFO: Found listing with ID: 1987664
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987664%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [ayvens.be] INFO: Scrape type for 1987664: 1
2026-03-27 22:47:27 [ayvens.be] INFO: Extracting data for car ID: 1987664
2026-03-27 22:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with identifier: 1987664
2026-03-27 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with scrape type 1
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/1.jpg not downloaded yet
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c39d0>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/4.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/2.jpg not downloaded yet
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/3.jpg not downloaded yet
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4595a90>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/3.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5463fd0>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/5.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/4.jpg not downloaded yet
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/5.jpg not downloaded yet
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a29d0>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/6.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f4d50>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/7.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/6.jpg not downloaded yet
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/7.jpg not downloaded yet
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571b650>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/9.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0950>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/10.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/8.jpg not downloaded yet
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/9.jpg not downloaded yet
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52de490>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1689f6c8665f4f0ea9dfd2ae69475abb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/8.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c71daee-9be4-5b33-9ee8-5781119bc903
2026-03-27 22:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c71daee-9be4-5b33-9ee8-5781119bc903, skipping ID generation
2026-03-27 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c71daee-9be4-5b33-9ee8-5781119bc903 with scrape type 1
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c71daee-9be4-5b33-9ee8-5781119bc903 sending to next pipeline
2026-03-27 22:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c71daee-9be4-5b33-9ee8-5781119bc903, identifier: 1987663
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45519d0>
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/1.jpg saved to cache
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/10.jpg not downloaded yet
2026-03-27 22:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c71daee-9be4-5b33-9ee8-5781119bc903 with identifier: 1987663
2026-03-27 22:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c71daee-9be4-5b33-9ee8-5781119bc903 with identifier: 1987663
2026-03-27 22:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c71daee-9be4-5b33-9ee8-5781119bc903 with identifier: 1987663 to the API
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3c71daee-9be4-5b33-9ee8-5781119bc903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 145291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c71daee-9be4-5b33-9ee8-5781119bc903/3c71daee-9be4-5b33-9ee8-5781119bc903_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1689f6c8665f4f0ea9dfd2ae69475abb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.5 BLUEHDI 110 S&S BUSINESS GPS',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 110 S&S BUSINESS GPS',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987663%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [ayvens.be] INFO: Saving data for 1987663: {'created_time': 1774651648.270572, 'last_price_update_time': 1774651648.270583, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987663') HTTP/1.1" 204 0
2026-03-27 22:47:28 [ayvens.be] INFO: Found listing with ID: 1987665
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987665%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [ayvens.be] INFO: Scrape type for 1987665: 1
2026-03-27 22:47:28 [ayvens.be] INFO: Extracting data for car ID: 1987665
2026-03-27 22:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff92f751-6672-59c2-ab49-693d21402a0b with identifier: 1987665
2026-03-27 22:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff92f751-6672-59c2-ab49-693d21402a0b with scrape type 1
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/1.jpg not downloaded yet
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ecf10>
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/2.jpg saved to cache
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f4bd0>
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/3.jpg saved to cache
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/2.jpg not downloaded yet
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/3.jpg not downloaded yet
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/4.jpg not downloaded yet
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/5.jpg not downloaded yet
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/6.jpg not downloaded yet
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/7.jpg not downloaded yet
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/8.jpg not downloaded yet
2026-03-27 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/9.jpg not downloaded yet
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2490>
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/6.jpg saved to cache
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c60d0>
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/4.jpg saved to cache
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/10.jpg not downloaded yet
2026-03-27 22:47:28 [ayvens.be] INFO: Found listing with ID: 1987666
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987666%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [ayvens.be] INFO: Scrape type for 1987666: 1
2026-03-27 22:47:28 [ayvens.be] INFO: Extracting data for car ID: 1987666
2026-03-27 22:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with identifier: 1987666
2026-03-27 22:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with scrape type 1
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/1.jpg not downloaded yet
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ef850>
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/5.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a2350>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/7.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5579150>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/8.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1690>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/9.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5427890>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/1.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/2.jpg not downloaded yet
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/3.jpg not downloaded yet
2026-03-27 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/4.jpg not downloaded yet
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/5.jpg not downloaded yet
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/6.jpg not downloaded yet
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/7.jpg not downloaded yet
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547b010>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/3.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b3190>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/2.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fde90>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/4.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/8.jpg not downloaded yet
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/9.jpg not downloaded yet
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547c690>
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F540a7b3f423f4de8ac63fcec6f5a0568%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/10.jpg saved to cache
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60
2026-03-27 22:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59eb6b0e-da29-5708-9ffc-2aab595b4a60, skipping ID generation
2026-03-27 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with scrape type 1
2026-03-27 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59eb6b0e-da29-5708-9ffc-2aab595b4a60 sending to next pipeline
2026-03-27 22:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59eb6b0e-da29-5708-9ffc-2aab595b4a60, identifier: 1987664
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e06d0>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/7.jpg saved to cache
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547dfd0>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/5.jpg saved to cache
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9290>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/6.jpg saved to cache
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5494d50>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/8.jpg saved to cache
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with identifier: 1987664
2026-03-27 22:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with identifier: 1987664
2026-03-27 22:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59eb6b0e-da29-5708-9ffc-2aab595b4a60 with identifier: 1987664 to the API
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '59eb6b0e-da29-5708-9ffc-2aab595b4a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C3 AIRCROSS DIESEL',
 'odometer': 89892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59eb6b0e-da29-5708-9ffc-2aab595b4a60/59eb6b0e-da29-5708-9ffc-2aab595b4a60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/540a7b3f423f4de8ac63fcec6f5a0568/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C3 AIRCROSS DIESEL 1.5 BlueHDi Feel S&S (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Feel S&S (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987664%27 HTTP/1.1" 200 None
2026-03-27 22:47:30 [ayvens.be] INFO: Saving data for 1987664: {'created_time': 1774651650.748275, 'last_price_update_time': 1774651650.748289, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987664') HTTP/1.1" 204 0
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/10.jpg not downloaded yet
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:30 [ayvens.be] INFO: Found listing with ID: 1987667
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987667%27 HTTP/1.1" 200 None
2026-03-27 22:47:30 [ayvens.be] INFO: Scrape type for 1987667: 1
2026-03-27 22:47:30 [ayvens.be] INFO: Extracting data for car ID: 1987667
2026-03-27 22:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f017534-2451-5c63-a171-5435d3225697 with identifier: 1987667
2026-03-27 22:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f017534-2451-5c63-a171-5435d3225697 with scrape type 1
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/1.jpg not downloaded yet
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f5410>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/9.jpg saved to cache
2026-03-27 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fc310>
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/1.jpg saved to cache
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/2.jpg not downloaded yet
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2a50>
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F48b93d4c12864e39bfd3f25fc08ce610%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/10.jpg saved to cache
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff92f751-6672-59c2-ab49-693d21402a0b
2026-03-27 22:47:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff92f751-6672-59c2-ab49-693d21402a0b, skipping ID generation
2026-03-27 22:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff92f751-6672-59c2-ab49-693d21402a0b with scrape type 1
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff92f751-6672-59c2-ab49-693d21402a0b sending to next pipeline
2026-03-27 22:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff92f751-6672-59c2-ab49-693d21402a0b, identifier: 1987665
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52cb950>
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/2.jpg saved to cache
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/3.jpg not downloaded yet
2026-03-27 22:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff92f751-6672-59c2-ab49-693d21402a0b with identifier: 1987665
2026-03-27 22:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff92f751-6672-59c2-ab49-693d21402a0b with identifier: 1987665
2026-03-27 22:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff92f751-6672-59c2-ab49-693d21402a0b with identifier: 1987665 to the API
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ff92f751-6672-59c2-ab49-693d21402a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 145801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff92f751-6672-59c2-ab49-693d21402a0b/ff92f751-6672-59c2-ab49-693d21402a0b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/48b93d4c12864e39bfd3f25fc08ce610/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 110KW LIFE DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW LIFE DSG',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987665%27 HTTP/1.1" 200 None
2026-03-27 22:47:31 [ayvens.be] INFO: Saving data for 1987665: {'created_time': 1774651651.981203, 'last_price_update_time': 1774651651.981213, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987665') HTTP/1.1" 204 0
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5496750>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/4.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55528d0>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/3.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/4.jpg not downloaded yet
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ff450>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/6.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fccd0>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/5.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/5.jpg not downloaded yet
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dce10>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/7.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5724d50>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/9.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/6.jpg not downloaded yet
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/7.jpg not downloaded yet
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c2b50>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/8.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497e10>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F501946c898f140cd964375a5bacb7987%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/10.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff
2026-03-27 22:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff, skipping ID generation
2026-03-27 22:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with scrape type 1
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5eb0585-b3c9-50c3-aa55-2a96710ce2ff sending to next pipeline
2026-03-27 22:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff, identifier: 1987666
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457c510>
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/1.jpg saved to cache
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/8.jpg not downloaded yet
2026-03-27 22:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with identifier: 1987666
2026-03-27 22:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with identifier: 1987666
2026-03-27 22:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5eb0585-b3c9-50c3-aa55-2a96710ce2ff with identifier: 1987666 to the API
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c5eb0585-b3c9-50c3-aa55-2a96710ce2ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 46177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5eb0585-b3c9-50c3-aa55-2a96710ce2ff/c5eb0585-b3c9-50c3-aa55-2a96710ce2ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/501946c898f140cd964375a5bacb7987/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.3 TCE 140 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 EQUILIBRE',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987666%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [ayvens.be] INFO: Saving data for 1987666: {'created_time': 1774651653.260109, 'last_price_update_time': 1774651653.260121, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987666') HTTP/1.1" 204 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/9.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534b190>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/2.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5b10>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/3.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/10.jpg not downloaded yet
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [ayvens.be] INFO: Found listing with ID: 1987668
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987668%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [ayvens.be] INFO: Scrape type for 1987668: 1
2026-03-27 22:47:33 [ayvens.be] INFO: Extracting data for car ID: 1987668
2026-03-27 22:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with identifier: 1987668
2026-03-27 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with scrape type 1
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/1.jpg not downloaded yet
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/2.jpg not downloaded yet
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/3.jpg not downloaded yet
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/4.jpg not downloaded yet
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/5.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4560c90>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/4.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/6.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505e90>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/5.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4530750>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/6.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/7.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0b10>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/7.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/8.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5624650>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/8.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/9.jpg not downloaded yet
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/10.jpg not downloaded yet
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:33 [ayvens.be] INFO: Found listing with ID: 1987669
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987669%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [ayvens.be] INFO: Scrape type for 1987669: 1
2026-03-27 22:47:33 [ayvens.be] INFO: Extracting data for car ID: 1987669
2026-03-27 22:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea24d0f1-e49d-5375-ba4c-0d08378317ec with identifier: 1987669
2026-03-27 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea24d0f1-e49d-5375-ba4c-0d08378317ec with scrape type 1
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/1.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5585810>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/10.jpg saved to cache
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/2.jpg not downloaded yet
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/3.jpg not downloaded yet
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5614490>
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/1.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459a650>
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/3.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b9950>
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fc9d67ebfcde7494d926b8f7fa03e0d3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/9.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f017534-2451-5c63-a171-5435d3225697
2026-03-27 22:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f017534-2451-5c63-a171-5435d3225697, skipping ID generation
2026-03-27 22:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f017534-2451-5c63-a171-5435d3225697 with scrape type 1
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f017534-2451-5c63-a171-5435d3225697 sending to next pipeline
2026-03-27 22:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f017534-2451-5c63-a171-5435d3225697, identifier: 1987667
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7510>
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/4.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549e010>
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/2.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4517dd0>
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/5.jpg saved to cache
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/4.jpg not downloaded yet
2026-03-27 22:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f017534-2451-5c63-a171-5435d3225697 with identifier: 1987667
2026-03-27 22:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f017534-2451-5c63-a171-5435d3225697 with identifier: 1987667
2026-03-27 22:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f017534-2451-5c63-a171-5435d3225697 with identifier: 1987667 to the API
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2f017534-2451-5c63-a171-5435d3225697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 47660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f017534-2451-5c63-a171-5435d3225697/2f017534-2451-5c63-a171-5435d3225697_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/c9d67ebfcde7494d926b8f7fa03e0d3f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.2 PURETECH 100 S&S FEEL',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 100 S&S FEEL',
 'vin': None,
 'year': 2023}
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987667%27 HTTP/1.1" 200 None
2026-03-27 22:47:34 [ayvens.be] INFO: Saving data for 1987667: {'created_time': 1774651654.98206, 'last_price_update_time': 1774651654.982071, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987667') HTTP/1.1" 204 0
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/5.jpg not downloaded yet
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/6.jpg not downloaded yet
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/7.jpg not downloaded yet
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/8.jpg not downloaded yet
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/9.jpg not downloaded yet
2026-03-27 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/10.jpg not downloaded yet
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316010>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/6.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5485210>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/9.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bf090>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/8.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:35 [ayvens.be] INFO: Found listing with ID: 1987670
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987670%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [ayvens.be] INFO: Scrape type for 1987670: 1
2026-03-27 22:47:35 [ayvens.be] INFO: Extracting data for car ID: 1987670
2026-03-27 22:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with identifier: 1987670
2026-03-27 22:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with scrape type 1
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/1.jpg not downloaded yet
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547c210>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/7.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/2.jpg not downloaded yet
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c3610>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fe5c190043d6a4b598c8736dcd04f70cb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/10.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96
2026-03-27 22:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96, skipping ID generation
2026-03-27 22:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with scrape type 1
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 sending to next pipeline
2026-03-27 22:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96, identifier: 1987668
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d65d0>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/1.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54845d0>
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/2.jpg saved to cache
2026-03-27 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with identifier: 1987668
2026-03-27 22:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with identifier: 1987668
2026-03-27 22:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0d91ee64-582c-5ac0-9330-9ccc59a2bc96 with identifier: 1987668 to the API
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0d91ee64-582c-5ac0-9330-9ccc59a2bc96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 92877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d91ee64-582c-5ac0-9330-9ccc59a2bc96/0d91ee64-582c-5ac0-9330-9ccc59a2bc96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/e5c190043d6a4b598c8736dcd04f70cb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO 1.0 TSI 81KW DSG LIFE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG LIFE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987668%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [ayvens.be] INFO: Saving data for 1987668: {'created_time': 1774651656.331377, 'last_price_update_time': 1774651656.331387, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987668') HTTP/1.1" 204 0
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/3.jpg not downloaded yet
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/4.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/5.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/6.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/7.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/8.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/9.jpg not downloaded yet
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/10.jpg not downloaded yet
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b14d0>
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/4.jpg saved to cache
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:36 [ayvens.be] INFO: Found listing with ID: 1987671
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987671%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [ayvens.be] INFO: Scrape type for 1987671: 1
2026-03-27 22:47:36 [ayvens.be] INFO: Extracting data for car ID: 1987671
2026-03-27 22:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c409cc1-455d-5022-93ef-510887adba58 with identifier: 1987671
2026-03-27 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c409cc1-455d-5022-93ef-510887adba58 with scrape type 1
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/1.jpg not downloaded yet
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549bd0>
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/5.jpg saved to cache
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531db50>
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/3.jpg saved to cache
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/2.jpg not downloaded yet
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/3.jpg not downloaded yet
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571af10>
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/6.jpg saved to cache
2026-03-27 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5418990>
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/7.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5496810>
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/8.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5718310>
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/9.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b22d0>
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc5a47561b2a64719bb066da3250ebabc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/10.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea24d0f1-e49d-5375-ba4c-0d08378317ec
2026-03-27 22:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea24d0f1-e49d-5375-ba4c-0d08378317ec, skipping ID generation
2026-03-27 22:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea24d0f1-e49d-5375-ba4c-0d08378317ec with scrape type 1
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea24d0f1-e49d-5375-ba4c-0d08378317ec sending to next pipeline
2026-03-27 22:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ea24d0f1-e49d-5375-ba4c-0d08378317ec, identifier: 1987669
2026-03-27 22:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ea24d0f1-e49d-5375-ba4c-0d08378317ec with identifier: 1987669
2026-03-27 22:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ea24d0f1-e49d-5375-ba4c-0d08378317ec with identifier: 1987669
2026-03-27 22:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ea24d0f1-e49d-5375-ba4c-0d08378317ec with identifier: 1987669 to the API
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ea24d0f1-e49d-5375-ba4c-0d08378317ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 FOU MWB MHR DSL - 20',
 'odometer': 97065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea24d0f1-e49d-5375-ba4c-0d08378317ec/ea24d0f1-e49d-5375-ba4c-0d08378317ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c5a47561b2a64719bb066da3250ebabc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 FOU MWB MHR DSL - 20 2.3 dCi 35 L2H2 En.Tw.Turbo '
          'Confort Qui. STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L2H2 En.Tw.Turbo Confort Qui. STOCK',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987669%27 HTTP/1.1" 200 None
2026-03-27 22:47:37 [ayvens.be] INFO: Saving data for 1987669: {'created_time': 1774651657.728941, 'last_price_update_time': 1774651657.728951, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987669') HTTP/1.1" 204 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/4.jpg not downloaded yet
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/5.jpg not downloaded yet
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5586c50>
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/1.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548f90>
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/5.jpg saved to cache
2026-03-27 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5461ad0>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/2.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1550>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/4.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dd190>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/6.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4490>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/3.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/6.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/7.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/8.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/9.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/10.jpg not downloaded yet
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [ayvens.be] INFO: Found listing with ID: 1987672
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987672%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [ayvens.be] INFO: Scrape type for 1987672: 1
2026-03-27 22:47:38 [ayvens.be] INFO: Extracting data for car ID: 1987672
2026-03-27 22:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with identifier: 1987672
2026-03-27 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with scrape type 1
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/1.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/2.jpg not downloaded yet
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54789d0>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/10.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/3.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/4.jpg not downloaded yet
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/5.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/6.jpg not downloaded yet
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/7.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/8.jpg not downloaded yet
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5719d90>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/9.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d64d0>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/8.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/9.jpg not downloaded yet
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/10.jpg not downloaded yet
2026-03-27 22:47:38 [ayvens.be] INFO: Found listing with ID: 1987673
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987673%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [ayvens.be] INFO: Scrape type for 1987673: 1
2026-03-27 22:47:38 [ayvens.be] INFO: Extracting data for car ID: 1987673
2026-03-27 22:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with identifier: 1987673
2026-03-27 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with scrape type 1
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/1.jpg not downloaded yet
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5726fd0>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/3.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5418cd0>
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252Fdb11785a4215466483dcf4851b2c1bf7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/7.jpg saved to cache
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5
2026-03-27 22:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5, skipping ID generation
2026-03-27 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with scrape type 1
2026-03-27 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 sending to next pipeline
2026-03-27 22:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5, identifier: 1987670
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5463010>
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/1.jpg saved to cache
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e3190>
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/2.jpg saved to cache
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56de210>
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/5.jpg saved to cache
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2d50>
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/4.jpg saved to cache
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with identifier: 1987670
2026-03-27 22:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with identifier: 1987670
2026-03-27 22:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c54e4c40-b3d7-5be6-95bb-26f89e2dbee5 with identifier: 1987670 to the API
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c54e4c40-b3d7-5be6-95bb-26f89e2dbee5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON MWB DSL - 20',
 'odometer': 190642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c54e4c40-b3d7-5be6-95bb-26f89e2dbee5/c54e4c40-b3d7-5be6-95bb-26f89e2dbee5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/db11785a4215466483dcf4851b2c1bf7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON MWB DSL - 20 2.0 dCi 29 L2H1 Grand '
          'Confort',
 'transmission': 'manual',
 'trim': '2.0 dCi 29 L2H1 Grand Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987670%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [ayvens.be] INFO: Saving data for 1987670: {'created_time': 1774651659.826669, 'last_price_update_time': 1774651659.826679, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987670') HTTP/1.1" 204 0
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/2.jpg not downloaded yet
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/3.jpg not downloaded yet
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/4.jpg not downloaded yet
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/5.jpg not downloaded yet
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/6.jpg not downloaded yet
2026-03-27 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/7.jpg not downloaded yet
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/8.jpg not downloaded yet
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45852d0>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/7.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5587350>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/6.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/9.jpg not downloaded yet
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553710>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/10.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5550cd0>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/9.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/10.jpg not downloaded yet
2026-03-27 22:47:40 [ayvens.be] INFO: Found listing with ID: 1987674
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987674%27 HTTP/1.1" 200 None
2026-03-27 22:47:40 [ayvens.be] INFO: Scrape type for 1987674: 1
2026-03-27 22:47:40 [ayvens.be] INFO: Extracting data for car ID: 1987674
2026-03-27 22:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd470dd7-e7d2-55cb-81ec-63425b0a425a with identifier: 1987674
2026-03-27 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd470dd7-e7d2-55cb-81ec-63425b0a425a with scrape type 1
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/1.jpg not downloaded yet
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bcd50>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/2.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560f650>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F8191b71ecdad4eb885e49c6d99d3b61f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/8.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c409cc1-455d-5022-93ef-510887adba58
2026-03-27 22:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c409cc1-455d-5022-93ef-510887adba58, skipping ID generation
2026-03-27 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c409cc1-455d-5022-93ef-510887adba58 with scrape type 1
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c409cc1-455d-5022-93ef-510887adba58 sending to next pipeline
2026-03-27 22:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c409cc1-455d-5022-93ef-510887adba58, identifier: 1987671
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4525f90>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/3.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c8bd0>
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/1.jpg saved to cache
2026-03-27 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c409cc1-455d-5022-93ef-510887adba58 with identifier: 1987671
2026-03-27 22:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c409cc1-455d-5022-93ef-510887adba58 with identifier: 1987671
2026-03-27 22:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c409cc1-455d-5022-93ef-510887adba58 with identifier: 1987671 to the API
2026-03-27 22:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c409cc1-455d-5022-93ef-510887adba58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 151136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c409cc1-455d-5022-93ef-510887adba58/3c409cc1-455d-5022-93ef-510887adba58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/8191b71ecdad4eb885e49c6d99d3b61f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987671%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [ayvens.be] INFO: Saving data for 1987671: {'created_time': 1774651661.15893, 'last_price_update_time': 1774651661.158941, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987671') HTTP/1.1" 204 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/2.jpg not downloaded yet
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/3.jpg not downloaded yet
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/4.jpg not downloaded yet
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/5.jpg not downloaded yet
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/6.jpg not downloaded yet
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/7.jpg not downloaded yet
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/8.jpg not downloaded yet
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5314290>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/5.jpg saved to cache
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/9.jpg not downloaded yet
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53164d0>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/4.jpg saved to cache
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c1a50>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/7.jpg saved to cache
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541c810>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/1.jpg saved to cache
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45298d0>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/6.jpg saved to cache
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/10.jpg not downloaded yet
2026-03-27 22:47:41 [ayvens.be] INFO: Found listing with ID: 1987675
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987675%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [ayvens.be] INFO: Scrape type for 1987675: 1
2026-03-27 22:47:41 [ayvens.be] INFO: Extracting data for car ID: 1987675
2026-03-27 22:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with identifier: 1987675
2026-03-27 22:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with scrape type 1
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/1.jpg not downloaded yet
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569eb10>
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/8.jpg saved to cache
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5686b10>
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/9.jpg saved to cache
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4527c90>
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fc687fc53b1f84e5f90670a06ba707a4a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/10.jpg saved to cache
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1
2026-03-27 22:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1, skipping ID generation
2026-03-27 22:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with scrape type 1
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 sending to next pipeline
2026-03-27 22:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1, identifier: 1987672
2026-03-27 22:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with identifier: 1987672
2026-03-27 22:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with identifier: 1987672
2026-03-27 22:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6cfcffa0-8133-58a4-8f32-d94e95bfdca1 with identifier: 1987672 to the API
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '6cfcffa0-8133-58a4-8f32-d94e95bfdca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 74457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cfcffa0-8133-58a4-8f32-d94e95bfdca1/6cfcffa0-8133-58a4-8f32-d94e95bfdca1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/c687fc53b1f84e5f90670a06ba707a4a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987672%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [ayvens.be] INFO: Saving data for 1987672: {'created_time': 1774651662.651713, 'last_price_update_time': 1774651662.651724, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987672') HTTP/1.1" 204 0
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/2.jpg not downloaded yet
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/3.jpg not downloaded yet
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/4.jpg not downloaded yet
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/5.jpg not downloaded yet
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/6.jpg not downloaded yet
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/7.jpg not downloaded yet
2026-03-27 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4d05c10>
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/2.jpg saved to cache
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/8.jpg not downloaded yet
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d0050>
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/9.jpg saved to cache
2026-03-27 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5463b10>
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/3.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/9.jpg not downloaded yet
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/10.jpg not downloaded yet
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ebdd0>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/5.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a14d0>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/6.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534aa90>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/4.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e4450>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/8.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5210>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/7.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e690>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/2.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [ayvens.be] INFO: Found listing with ID: 1987676
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987676%27 HTTP/1.1" 200 None
2026-03-27 22:47:43 [ayvens.be] INFO: Scrape type for 1987676: 1
2026-03-27 22:47:43 [ayvens.be] INFO: Extracting data for car ID: 1987676
2026-03-27 22:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e35cf86-83a5-5382-aa3c-b62f71f28052 with identifier: 1987676
2026-03-27 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e35cf86-83a5-5382-aa3c-b62f71f28052 with scrape type 1
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/1.jpg not downloaded yet
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/2.jpg not downloaded yet
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55efad0>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/1.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ff7d0>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/10.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4521ad0>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/6.jpg saved to cache
2026-03-27 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5587d10>
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/7.jpg saved to cache
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/3.jpg not downloaded yet
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/4.jpg not downloaded yet
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/5.jpg not downloaded yet
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bb490>
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/9.jpg saved to cache
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bf410>
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/1.jpg saved to cache
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5494a10>
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F98b12090d9c94d41869fe8c6bfab8ff1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/10.jpg saved to cache
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9
2026-03-27 22:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9, skipping ID generation
2026-03-27 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with scrape type 1
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 sending to next pipeline
2026-03-27 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9, identifier: 1987673
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5686b10>
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/8.jpg saved to cache
2026-03-27 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with identifier: 1987673
2026-03-27 22:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with identifier: 1987673
2026-03-27 22:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 01fe6002-cd4d-565e-8de6-348f3a2ce4a9 with identifier: 1987673 to the API
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '01fe6002-cd4d-565e-8de6-348f3a2ce4a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 149040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe6002-cd4d-565e-8de6-348f3a2ce4a9/01fe6002-cd4d-565e-8de6-348f3a2ce4a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/98b12090d9c94d41869fe8c6bfab8ff1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987673%27 HTTP/1.1" 200 None
2026-03-27 22:47:44 [ayvens.be] INFO: Saving data for 1987673: {'created_time': 1774651664.96946, 'last_price_update_time': 1774651664.96947, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987673') HTTP/1.1" 204 0
2026-03-27 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/6.jpg not downloaded yet
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/7.jpg not downloaded yet
2026-03-27 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed5d0>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/4.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d0d10>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/2.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a7750>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/3.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547a990>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/3.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bddd0>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/7.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ee10>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe055cfad961649088319ad9fc5301b00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/5.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd470dd7-e7d2-55cb-81ec-63425b0a425a
2026-03-27 22:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd470dd7-e7d2-55cb-81ec-63425b0a425a, skipping ID generation
2026-03-27 22:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd470dd7-e7d2-55cb-81ec-63425b0a425a with scrape type 1
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd470dd7-e7d2-55cb-81ec-63425b0a425a sending to next pipeline
2026-03-27 22:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd470dd7-e7d2-55cb-81ec-63425b0a425a, identifier: 1987674
2026-03-27 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/8.jpg not downloaded yet
2026-03-27 22:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd470dd7-e7d2-55cb-81ec-63425b0a425a with identifier: 1987674
2026-03-27 22:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd470dd7-e7d2-55cb-81ec-63425b0a425a with identifier: 1987674
2026-03-27 22:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd470dd7-e7d2-55cb-81ec-63425b0a425a with identifier: 1987674 to the API
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bd470dd7-e7d2-55cb-81ec-63425b0a425a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 195224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd470dd7-e7d2-55cb-81ec-63425b0a425a/bd470dd7-e7d2-55cb-81ec-63425b0a425a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e055cfad961649088319ad9fc5301b00/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 40 TFSI 150KW S TRONIC QTRO COMPETIT',
 'transmission': 'automatic',
 'trim': '2.0 40 TFSI 150KW S TRONIC QTRO COMPETIT',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987674%27 HTTP/1.1" 200 None
2026-03-27 22:47:45 [ayvens.be] INFO: Saving data for 1987674: {'created_time': 1774651665.846284, 'last_price_update_time': 1774651665.846294, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987674') HTTP/1.1" 204 0
2026-03-27 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/9.jpg not downloaded yet
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5426e50>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/8.jpg saved to cache
2026-03-27 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed210>
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/6.jpg saved to cache
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/10.jpg not downloaded yet
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ec090>
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/4.jpg saved to cache
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:46 [ayvens.be] INFO: Found listing with ID: 1987677
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987677%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [ayvens.be] INFO: Scrape type for 1987677: 1
2026-03-27 22:47:46 [ayvens.be] INFO: Extracting data for car ID: 1987677
2026-03-27 22:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e070571b-7004-5e0a-98e8-99f0b370ad66 with identifier: 1987677
2026-03-27 22:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e070571b-7004-5e0a-98e8-99f0b370ad66 with scrape type 1
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/1.jpg not downloaded yet
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6950>
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/5.jpg saved to cache
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e210>
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/9.jpg saved to cache
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4560e90>
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fcbac5ac25e2f4f589d2cc38f7510cce4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/10.jpg saved to cache
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37
2026-03-27 22:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3994cba4-6ba2-5389-b939-7f5a1db5dc37, skipping ID generation
2026-03-27 22:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with scrape type 1
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3994cba4-6ba2-5389-b939-7f5a1db5dc37 sending to next pipeline
2026-03-27 22:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3994cba4-6ba2-5389-b939-7f5a1db5dc37, identifier: 1987675
2026-03-27 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/2.jpg not downloaded yet
2026-03-27 22:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with identifier: 1987675
2026-03-27 22:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with identifier: 1987675
2026-03-27 22:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3994cba4-6ba2-5389-b939-7f5a1db5dc37 with identifier: 1987675 to the API
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3994cba4-6ba2-5389-b939-7f5a1db5dc37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 98522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3994cba4-6ba2-5389-b939-7f5a1db5dc37/3994cba4-6ba2-5389-b939-7f5a1db5dc37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/cbac5ac25e2f4f589d2cc38f7510cce4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987675%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [ayvens.be] INFO: Saving data for 1987675: {'created_time': 1774651666.878682, 'last_price_update_time': 1774651666.878692, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987675') HTTP/1.1" 204 0
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/3.jpg not downloaded yet
2026-03-27 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/4.jpg not downloaded yet
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a82d0>
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/1.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/5.jpg not downloaded yet
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/6.jpg not downloaded yet
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571a410>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/3.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5442dd0>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/2.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/7.jpg not downloaded yet
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/8.jpg not downloaded yet
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/9.jpg not downloaded yet
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4506e50>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/4.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5440d90>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/5.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fc8d0>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/7.jpg saved to cache
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/10.jpg not downloaded yet
2026-03-27 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:47 [ayvens.be] INFO: Found listing with ID: 1987678
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987678%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [ayvens.be] INFO: Scrape type for 1987678: 1
2026-03-27 22:47:47 [ayvens.be] INFO: Extracting data for car ID: 1987678
2026-03-27 22:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4826782-a841-5f27-a2a2-185016543e5a with identifier: 1987678
2026-03-27 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4826782-a841-5f27-a2a2-185016543e5a with scrape type 1
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/1.jpg not downloaded yet
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5460e90>
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/8.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e5e50>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/6.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/2.jpg not downloaded yet
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/3.jpg not downloaded yet
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a58d0>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/9.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/4.jpg not downloaded yet
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/5.jpg not downloaded yet
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540cbd0>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe168e3a0d57d4d3e961f9d55fd04fa3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/10.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e35cf86-83a5-5382-aa3c-b62f71f28052
2026-03-27 22:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e35cf86-83a5-5382-aa3c-b62f71f28052, skipping ID generation
2026-03-27 22:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e35cf86-83a5-5382-aa3c-b62f71f28052 with scrape type 1
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e35cf86-83a5-5382-aa3c-b62f71f28052 sending to next pipeline
2026-03-27 22:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2e35cf86-83a5-5382-aa3c-b62f71f28052, identifier: 1987676
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7048110>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/1.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e510>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/2.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e139d0>
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/3.jpg saved to cache
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/6.jpg not downloaded yet
2026-03-27 22:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2e35cf86-83a5-5382-aa3c-b62f71f28052 with identifier: 1987676
2026-03-27 22:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2e35cf86-83a5-5382-aa3c-b62f71f28052 with identifier: 1987676
2026-03-27 22:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2e35cf86-83a5-5382-aa3c-b62f71f28052 with identifier: 1987676 to the API
2026-03-27 22:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2e35cf86-83a5-5382-aa3c-b62f71f28052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 101205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e35cf86-83a5-5382-aa3c-b62f71f28052/2e35cf86-83a5-5382-aa3c-b62f71f28052_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e168e3a0d57d4d3e961f9d55fd04fa3f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 PHEV 225 RIVOLI AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 RIVOLI AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987676%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [ayvens.be] INFO: Saving data for 1987676: {'created_time': 1774651669.149215, 'last_price_update_time': 1774651669.149224, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987676') HTTP/1.1" 204 0
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/7.jpg not downloaded yet
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/8.jpg not downloaded yet
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459cd10>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/5.jpg saved to cache
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4790>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/4.jpg saved to cache
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/9.jpg not downloaded yet
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/10.jpg not downloaded yet
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a9250>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/6.jpg saved to cache
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [ayvens.be] INFO: Found listing with ID: 1987679
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987679%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [ayvens.be] INFO: Scrape type for 1987679: 1
2026-03-27 22:47:49 [ayvens.be] INFO: Extracting data for car ID: 1987679
2026-03-27 22:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a43a2d-df00-5696-8471-07797c0d9ab2 with identifier: 1987679
2026-03-27 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a43a2d-df00-5696-8471-07797c0d9ab2 with scrape type 1
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/1.jpg not downloaded yet
2026-03-27 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/2.jpg not downloaded yet
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566ea90>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/9.jpg saved to cache
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56deed0>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/10.jpg saved to cache
2026-03-27 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5632750>
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/8.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478c10>
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wd%252Fb3b949c1bdab4cbd9f3e5ba2ce1139a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/7.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e070571b-7004-5e0a-98e8-99f0b370ad66
2026-03-27 22:47:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e070571b-7004-5e0a-98e8-99f0b370ad66, skipping ID generation
2026-03-27 22:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e070571b-7004-5e0a-98e8-99f0b370ad66 with scrape type 1
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e070571b-7004-5e0a-98e8-99f0b370ad66 sending to next pipeline
2026-03-27 22:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e070571b-7004-5e0a-98e8-99f0b370ad66, identifier: 1987677
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e4ced210>
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/2.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/3.jpg not downloaded yet
2026-03-27 22:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e070571b-7004-5e0a-98e8-99f0b370ad66 with identifier: 1987677
2026-03-27 22:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e070571b-7004-5e0a-98e8-99f0b370ad66 with identifier: 1987677
2026-03-27 22:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e070571b-7004-5e0a-98e8-99f0b370ad66 with identifier: 1987677 to the API
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e070571b-7004-5e0a-98e8-99f0b370ad66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 27 FOURGON SWB DSL - 20',
 'odometer': 150833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e070571b-7004-5e0a-98e8-99f0b370ad66/e070571b-7004-5e0a-98e8-99f0b370ad66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wd/b3b949c1bdab4cbd9f3e5ba2ce1139a6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 27 FOURGON SWB DSL - 20 1.6 dCi 27 L1H1 Confort '
          'STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 27 L1H1 Confort STOCK',
 'vin': None,
 'year': 2019}
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987677%27 HTTP/1.1" 200 None
2026-03-27 22:47:50 [ayvens.be] INFO: Saving data for 1987677: {'created_time': 1774651670.690149, 'last_price_update_time': 1774651670.69016, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987677') HTTP/1.1" 204 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/4.jpg not downloaded yet
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b37d0>
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/1.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe490>
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/4.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/5.jpg not downloaded yet
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2510>
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/3.jpg saved to cache
2026-03-27 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/6.jpg not downloaded yet
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/7.jpg not downloaded yet
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/8.jpg not downloaded yet
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/9.jpg not downloaded yet
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/10.jpg not downloaded yet
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [ayvens.be] INFO: Found listing with ID: 1987680
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987680%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [ayvens.be] INFO: Scrape type for 1987680: 1
2026-03-27 22:47:51 [ayvens.be] INFO: Extracting data for car ID: 1987680
2026-03-27 22:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a2c2ae-07b4-5d71-9394-e41d84e04846 with identifier: 1987680
2026-03-27 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a2c2ae-07b4-5d71-9394-e41d84e04846 with scrape type 1
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/1.jpg not downloaded yet
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/2.jpg not downloaded yet
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0f90>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/5.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5626c50>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/10.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5616510>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/6.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/3.jpg not downloaded yet
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e10790>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/8.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5625650>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/9.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5565e50>
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad844dae8edc45f3867aa16b8c750834%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/7.jpg saved to cache
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4826782-a841-5f27-a2a2-185016543e5a
2026-03-27 22:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4826782-a841-5f27-a2a2-185016543e5a, skipping ID generation
2026-03-27 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4826782-a841-5f27-a2a2-185016543e5a with scrape type 1
2026-03-27 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4826782-a841-5f27-a2a2-185016543e5a sending to next pipeline
2026-03-27 22:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4826782-a841-5f27-a2a2-185016543e5a, identifier: 1987678
2026-03-27 22:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4826782-a841-5f27-a2a2-185016543e5a with identifier: 1987678
2026-03-27 22:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4826782-a841-5f27-a2a2-185016543e5a with identifier: 1987678
2026-03-27 22:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4826782-a841-5f27-a2a2-185016543e5a with identifier: 1987678 to the API
2026-03-27 22:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f4826782-a841-5f27-a2a2-185016543e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 189870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4826782-a841-5f27-a2a2-185016543e5a/f4826782-a841-5f27-a2a2-185016543e5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad844dae8edc45f3867aa16b8c750834/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.6 PURETECH 180 AUTO GT',
 'transmission': 'automatic',
 'trim': '1.6 PURETECH 180 AUTO GT',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987678%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [ayvens.be] INFO: Saving data for 1987678: {'created_time': 1774651672.183455, 'last_price_update_time': 1774651672.183466, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987678') HTTP/1.1" 204 0
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/4.jpg not downloaded yet
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d786b310>
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/1.jpg saved to cache
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459c750>
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/3.jpg saved to cache
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/5.jpg not downloaded yet
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/6.jpg not downloaded yet
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/7.jpg not downloaded yet
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/8.jpg not downloaded yet
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/9.jpg not downloaded yet
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/10.jpg not downloaded yet
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4552a10>
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/4.jpg saved to cache
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [ayvens.be] INFO: Found listing with ID: 1987681
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987681%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [ayvens.be] INFO: Scrape type for 1987681: 1
2026-03-27 22:47:52 [ayvens.be] INFO: Extracting data for car ID: 1987681
2026-03-27 22:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f331a6a8-91a4-5343-84f6-070f132abbf4 with identifier: 1987681
2026-03-27 22:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f331a6a8-91a4-5343-84f6-070f132abbf4 with scrape type 1
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/1.jpg not downloaded yet
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/2.jpg not downloaded yet
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5555350>
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/2.jpg saved to cache
2026-03-27 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5727fd0>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/9.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5440810>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/6.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5487bd0>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/5.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5484850>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/7.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556050>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/8.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531c910>
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fa12ddc97332b4275aa16e0aaccd00062%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/10.jpg saved to cache
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6a43a2d-df00-5696-8471-07797c0d9ab2
2026-03-27 22:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6a43a2d-df00-5696-8471-07797c0d9ab2, skipping ID generation
2026-03-27 22:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a43a2d-df00-5696-8471-07797c0d9ab2 with scrape type 1
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6a43a2d-df00-5696-8471-07797c0d9ab2 sending to next pipeline
2026-03-27 22:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6a43a2d-df00-5696-8471-07797c0d9ab2, identifier: 1987679
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/3.jpg not downloaded yet
2026-03-27 22:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6a43a2d-df00-5696-8471-07797c0d9ab2 with identifier: 1987679
2026-03-27 22:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6a43a2d-df00-5696-8471-07797c0d9ab2 with identifier: 1987679
2026-03-27 22:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6a43a2d-df00-5696-8471-07797c0d9ab2 with identifier: 1987679 to the API
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e6a43a2d-df00-5696-8471-07797c0d9ab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 69344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a43a2d-df00-5696-8471-07797c0d9ab2/e6a43a2d-df00-5696-8471-07797c0d9ab2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/a12ddc97332b4275aa16e0aaccd00062/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.2 Turbo Edition (EU6.2) STOCK',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Edition (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987679%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [ayvens.be] INFO: Saving data for 1987679: {'created_time': 1774651674.10082, 'last_price_update_time': 1774651674.100829, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987679') HTTP/1.1" 204 0
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/4.jpg not downloaded yet
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2b90>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/1.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56307d0>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/3.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ecd50>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/4.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c8090>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/2.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/5.jpg not downloaded yet
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/6.jpg not downloaded yet
2026-03-27 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5340f90>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/6.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e3846150>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/5.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c2210>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/7.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/7.jpg not downloaded yet
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/8.jpg not downloaded yet
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc2b90>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/9.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc3210>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/10.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d30f50>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/1.jpg saved to cache
2026-03-27 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ca590>
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1a4209793a50445fa92a8ecf589d2231%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/8.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81a2c2ae-07b4-5d71-9394-e41d84e04846
2026-03-27 22:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81a2c2ae-07b4-5d71-9394-e41d84e04846, skipping ID generation
2026-03-27 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a2c2ae-07b4-5d71-9394-e41d84e04846 with scrape type 1
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81a2c2ae-07b4-5d71-9394-e41d84e04846 sending to next pipeline
2026-03-27 22:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81a2c2ae-07b4-5d71-9394-e41d84e04846, identifier: 1987680
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81a2c2ae-07b4-5d71-9394-e41d84e04846 with identifier: 1987680
2026-03-27 22:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81a2c2ae-07b4-5d71-9394-e41d84e04846 with identifier: 1987680
2026-03-27 22:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81a2c2ae-07b4-5d71-9394-e41d84e04846 with identifier: 1987680 to the API
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '81a2c2ae-07b4-5d71-9394-e41d84e04846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB DIESEL - 2019',
 'odometer': 148575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a2c2ae-07b4-5d71-9394-e41d84e04846/81a2c2ae-07b4-5d71-9394-e41d84e04846_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1a4209793a50445fa92a8ecf589d2231/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB DIESEL - 2019 2.0 CR TDi Sportline DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi Sportline DSG',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987680%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [ayvens.be] INFO: Saving data for 1987680: {'created_time': 1774651675.506915, 'last_price_update_time': 1774651675.506926, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987680') HTTP/1.1" 204 0
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/9.jpg not downloaded yet
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/10.jpg not downloaded yet
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5657cd0>
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/3.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5625990>
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/2.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [ayvens.be] INFO: Found listing with ID: 1987682
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987682%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [ayvens.be] INFO: Scrape type for 1987682: 1
2026-03-27 22:47:55 [ayvens.be] INFO: Extracting data for car ID: 1987682
2026-03-27 22:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894454bc-3d3f-5aa5-a1aa-73212580aca7 with identifier: 1987682
2026-03-27 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894454bc-3d3f-5aa5-a1aa-73212580aca7 with scrape type 1
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/1.jpg not downloaded yet
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/2.jpg not downloaded yet
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ff490>
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/4.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/3.jpg not downloaded yet
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/4.jpg not downloaded yet
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5657050>
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/5.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540f150>
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/6.jpg saved to cache
2026-03-27 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/5.jpg not downloaded yet
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/6.jpg not downloaded yet
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5631850>
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/7.jpg saved to cache
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a4510>
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/8.jpg saved to cache
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/7.jpg not downloaded yet
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/8.jpg not downloaded yet
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653690>
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/9.jpg saved to cache
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/9.jpg not downloaded yet
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/10.jpg not downloaded yet
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [ayvens.be] INFO: Found listing with ID: 1987683
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987683%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [ayvens.be] INFO: Scrape type for 1987683: 1
2026-03-27 22:47:56 [ayvens.be] INFO: Extracting data for car ID: 1987683
2026-03-27 22:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5252a994-29f9-547e-b6c7-01c20376b98f with identifier: 1987683
2026-03-27 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5252a994-29f9-547e-b6c7-01c20376b98f with scrape type 1
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/1.jpg not downloaded yet
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/2.jpg not downloaded yet
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54311d0>
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F64bcf4d5783349108f4733a4170ecc23%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/10.jpg saved to cache
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f331a6a8-91a4-5343-84f6-070f132abbf4
2026-03-27 22:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f331a6a8-91a4-5343-84f6-070f132abbf4, skipping ID generation
2026-03-27 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f331a6a8-91a4-5343-84f6-070f132abbf4 with scrape type 1
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f331a6a8-91a4-5343-84f6-070f132abbf4 sending to next pipeline
2026-03-27 22:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f331a6a8-91a4-5343-84f6-070f132abbf4, identifier: 1987681
2026-03-27 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/3.jpg not downloaded yet
2026-03-27 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f331a6a8-91a4-5343-84f6-070f132abbf4 with identifier: 1987681
2026-03-27 22:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f331a6a8-91a4-5343-84f6-070f132abbf4 with identifier: 1987681
2026-03-27 22:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f331a6a8-91a4-5343-84f6-070f132abbf4 with identifier: 1987681 to the API
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f331a6a8-91a4-5343-84f6-070f132abbf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 198966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f331a6a8-91a4-5343-84f6-070f132abbf4/f331a6a8-91a4-5343-84f6-070f132abbf4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/64bcf4d5783349108f4733a4170ecc23/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2021}
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987681%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [ayvens.be] INFO: Saving data for 1987681: {'created_time': 1774651677.08477, 'last_price_update_time': 1774651677.084783, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987681') HTTP/1.1" 204 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/4.jpg not downloaded yet
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45878d0>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/1.jpg saved to cache
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b21d0>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/2.jpg saved to cache
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541fb90>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/3.jpg saved to cache
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5463e10>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/4.jpg saved to cache
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5441550>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/5.jpg saved to cache
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/5.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/6.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/7.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/8.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/9.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/10.jpg not downloaded yet
2026-03-27 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:57 [ayvens.be] INFO: Found listing with ID: 1987684
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987684%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [ayvens.be] INFO: Scrape type for 1987684: 1
2026-03-27 22:47:57 [ayvens.be] INFO: Extracting data for car ID: 1987684
2026-03-27 22:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with identifier: 1987684
2026-03-27 22:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with scrape type 1
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/1.jpg not downloaded yet
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc10d0>
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/7.jpg saved to cache
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d1a50>
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/6.jpg saved to cache
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/2.jpg not downloaded yet
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53730d0>
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/9.jpg saved to cache
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d796ab90>
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/8.jpg saved to cache
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b7850>
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fa18f76c2716b4a84977cd3efb16a8fdf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/10.jpg saved to cache
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 894454bc-3d3f-5aa5-a1aa-73212580aca7
2026-03-27 22:47:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 894454bc-3d3f-5aa5-a1aa-73212580aca7, skipping ID generation
2026-03-27 22:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894454bc-3d3f-5aa5-a1aa-73212580aca7 with scrape type 1
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 894454bc-3d3f-5aa5-a1aa-73212580aca7 sending to next pipeline
2026-03-27 22:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 894454bc-3d3f-5aa5-a1aa-73212580aca7, identifier: 1987682
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/3.jpg not downloaded yet
2026-03-27 22:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 894454bc-3d3f-5aa5-a1aa-73212580aca7 with identifier: 1987682
2026-03-27 22:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 894454bc-3d3f-5aa5-a1aa-73212580aca7 with identifier: 1987682
2026-03-27 22:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 894454bc-3d3f-5aa5-a1aa-73212580aca7 with identifier: 1987682 to the API
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '894454bc-3d3f-5aa5-a1aa-73212580aca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS7 CROSSBACK',
 'odometer': 130013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894454bc-3d3f-5aa5-a1aa-73212580aca7/894454bc-3d3f-5aa5-a1aa-73212580aca7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/a18f76c2716b4a84977cd3efb16a8fdf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS7 CROSSBACK 1.6 E-TENSE 4x4 Grand Chic (EU6.3)',
 'transmission': 'automatic',
 'trim': '1.6 E-TENSE 4x4 Grand Chic (EU6.3)',
 'vin': None,
 'year': 2020}
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987682%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [ayvens.be] INFO: Saving data for 1987682: {'created_time': 1774651679.02747, 'last_price_update_time': 1774651679.027481, 'auction_closing_time': 1775115000.0}
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987682') HTTP/1.1" 204 0
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/4.jpg not downloaded yet
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7055890>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/2.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c92d0>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/1.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/5.jpg not downloaded yet
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/6.jpg not downloaded yet
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553a50>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/3.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/7.jpg not downloaded yet
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/8.jpg not downloaded yet
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/9.jpg not downloaded yet
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bf410>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/4.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b6490>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/7.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/10.jpg not downloaded yet
2026-03-27 22:47:59 [ayvens.be] INFO: Found listing with ID: 1987685
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987685%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [ayvens.be] INFO: Scrape type for 1987685: 1
2026-03-27 22:47:59 [ayvens.be] INFO: Extracting data for car ID: 1987685
2026-03-27 22:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb28776f-9eb2-5246-8fc7-47dd1a0e692a with identifier: 1987685
2026-03-27 22:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a with scrape type 1
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/1.jpg not downloaded yet
2026-03-27 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d1090>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/5.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54782d0>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/6.jpg saved to cache
2026-03-27 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f750>
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/8.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a9510>
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/9.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5726410>
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/1.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547bd90>
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fb6f3ba23aade4cbb9dc056075564eaa3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/10.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5252a994-29f9-547e-b6c7-01c20376b98f
2026-03-27 22:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5252a994-29f9-547e-b6c7-01c20376b98f, skipping ID generation
2026-03-27 22:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5252a994-29f9-547e-b6c7-01c20376b98f with scrape type 1
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5252a994-29f9-547e-b6c7-01c20376b98f sending to next pipeline
2026-03-27 22:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5252a994-29f9-547e-b6c7-01c20376b98f, identifier: 1987683
2026-03-27 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/2.jpg not downloaded yet
2026-03-27 22:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5252a994-29f9-547e-b6c7-01c20376b98f with identifier: 1987683
2026-03-27 22:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5252a994-29f9-547e-b6c7-01c20376b98f with identifier: 1987683
2026-03-27 22:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5252a994-29f9-547e-b6c7-01c20376b98f with identifier: 1987683 to the API
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5252a994-29f9-547e-b6c7-01c20376b98f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 149874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5252a994-29f9-547e-b6c7-01c20376b98f/5252a994-29f9-547e-b6c7-01c20376b98f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/b6f3ba23aade4cbb9dc056075564eaa3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 2.0 35 TDI S TRONIC S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC S LINE BUSINESS ED',
 'vin': None,
 'year': 2023}
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987683%27 HTTP/1.1" 200 None
2026-03-27 22:48:00 [ayvens.be] INFO: Saving data for 1987683: {'created_time': 1774651680.848137, 'last_price_update_time': 1774651680.848148, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987683') HTTP/1.1" 204 0
2026-03-27 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/3.jpg not downloaded yet
2026-03-27 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459fc50>
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/2.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556550>
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/3.jpg saved to cache
2026-03-27 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/4.jpg not downloaded yet
2026-03-27 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/5.jpg not downloaded yet
2026-03-27 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5656910>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/7.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458ecd0>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/5.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4564b90>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/4.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5010>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/6.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/6.jpg not downloaded yet
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/7.jpg not downloaded yet
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4566b50>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/8.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566cd10>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/10.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753ddd0>
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0b205be2565d4ce5a711cda4ccf702b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/9.jpg saved to cache
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb
2026-03-27 22:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb, skipping ID generation
2026-03-27 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with scrape type 1
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f43a21af-20aa-59e8-8cfa-df1a67e9f4fb sending to next pipeline
2026-03-27 22:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb, identifier: 1987684
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/8.jpg not downloaded yet
2026-03-27 22:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with identifier: 1987684
2026-03-27 22:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with identifier: 1987684
2026-03-27 22:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f43a21af-20aa-59e8-8cfa-df1a67e9f4fb with identifier: 1987684 to the API
2026-03-27 22:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f43a21af-20aa-59e8-8cfa-df1a67e9f4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 144465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43a21af-20aa-59e8-8cfa-df1a67e9f4fb/f43a21af-20aa-59e8-8cfa-df1a67e9f4fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0b205be2565d4ce5a711cda4ccf702b6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987684%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [ayvens.be] INFO: Saving data for 1987684: {'created_time': 1774651682.181449, 'last_price_update_time': 1774651682.181459, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987684') HTTP/1.1" 204 0
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/9.jpg not downloaded yet
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/10.jpg not downloaded yet
2026-03-27 22:48:02 [ayvens.be] INFO: Found listing with ID: 1987686
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987686%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [ayvens.be] INFO: Scrape type for 1987686: 1
2026-03-27 22:48:02 [ayvens.be] INFO: Extracting data for car ID: 1987686
2026-03-27 22:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35d02ca-c350-5ebb-9140-f1118f06879d with identifier: 1987686
2026-03-27 22:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35d02ca-c350-5ebb-9140-f1118f06879d with scrape type 1
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/1.jpg not downloaded yet
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/2.jpg not downloaded yet
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/3.jpg not downloaded yet
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/4.jpg not downloaded yet
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/5.jpg not downloaded yet
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/6.jpg not downloaded yet
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/7.jpg not downloaded yet
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/8.jpg not downloaded yet
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8550>
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/2.jpg saved to cache
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d310d0>
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/3.jpg saved to cache
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497210>
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/1.jpg saved to cache
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/9.jpg not downloaded yet
2026-03-27 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ead0>
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/5.jpg saved to cache
2026-03-27 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56577d0>
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/4.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/10.jpg not downloaded yet
2026-03-27 22:48:03 [ayvens.be] INFO: Found listing with ID: 1987687
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987687%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [ayvens.be] INFO: Scrape type for 1987687: 1
2026-03-27 22:48:03 [ayvens.be] INFO: Extracting data for car ID: 1987687
2026-03-27 22:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with identifier: 1987687
2026-03-27 22:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with scrape type 1
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/1.jpg not downloaded yet
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c3450>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/6.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eb450>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/7.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ebb10>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/8.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/2.jpg not downloaded yet
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/3.jpg not downloaded yet
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/4.jpg not downloaded yet
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/5.jpg not downloaded yet
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/6.jpg not downloaded yet
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c1310>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/1.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/7.jpg not downloaded yet
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/8.jpg not downloaded yet
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dec50>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/3.jpg saved to cache
2026-03-27 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c17d0>
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/4.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7850>
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/2.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5566d50>
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/5.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6390>
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/9.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531df10>
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F7f4748194dc94d3e85051e6c5dc97e4b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/10.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a
2026-03-27 22:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb28776f-9eb2-5246-8fc7-47dd1a0e692a, skipping ID generation
2026-03-27 22:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a with scrape type 1
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb28776f-9eb2-5246-8fc7-47dd1a0e692a sending to next pipeline
2026-03-27 22:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cb28776f-9eb2-5246-8fc7-47dd1a0e692a, identifier: 1987685
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5686b10>
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/6.jpg saved to cache
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/9.jpg not downloaded yet
2026-03-27 22:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cb28776f-9eb2-5246-8fc7-47dd1a0e692a with identifier: 1987685
2026-03-27 22:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cb28776f-9eb2-5246-8fc7-47dd1a0e692a with identifier: 1987685
2026-03-27 22:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cb28776f-9eb2-5246-8fc7-47dd1a0e692a with identifier: 1987685 to the API
2026-03-27 22:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cb28776f-9eb2-5246-8fc7-47dd1a0e692a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 198535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb28776f-9eb2-5246-8fc7-47dd1a0e692a/cb28776f-9eb2-5246-8fc7-47dd1a0e692a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/7f4748194dc94d3e85051e6c5dc97e4b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318DA (110KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) TOURING',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987685%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [ayvens.be] INFO: Saving data for 1987685: {'created_time': 1774651685.225972, 'last_price_update_time': 1774651685.225981, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987685') HTTP/1.1" 204 0
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/10.jpg not downloaded yet
2026-03-27 22:48:05 [ayvens.be] INFO: Found listing with ID: 1987688
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987688%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [ayvens.be] INFO: Scrape type for 1987688: 1
2026-03-27 22:48:05 [ayvens.be] INFO: Extracting data for car ID: 1987688
2026-03-27 22:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with identifier: 1987688
2026-03-27 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with scrape type 1
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/1.jpg not downloaded yet
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/2.jpg not downloaded yet
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/3.jpg not downloaded yet
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/4.jpg not downloaded yet
2026-03-27 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/5.jpg not downloaded yet
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/6.jpg not downloaded yet
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/7.jpg not downloaded yet
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53a3510>
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/7.jpg saved to cache
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9090>
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/1.jpg saved to cache
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566f310>
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/10.jpg saved to cache
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c80d0>
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/9.jpg saved to cache
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/8.jpg not downloaded yet
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c98d0>
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/3.jpg saved to cache
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bcc90>
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F18f0ac09007d482ab5ed7b0f5c1064cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/8.jpg saved to cache
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b35d02ca-c350-5ebb-9140-f1118f06879d
2026-03-27 22:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b35d02ca-c350-5ebb-9140-f1118f06879d, skipping ID generation
2026-03-27 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35d02ca-c350-5ebb-9140-f1118f06879d with scrape type 1
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b35d02ca-c350-5ebb-9140-f1118f06879d sending to next pipeline
2026-03-27 22:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b35d02ca-c350-5ebb-9140-f1118f06879d, identifier: 1987686
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/9.jpg not downloaded yet
2026-03-27 22:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b35d02ca-c350-5ebb-9140-f1118f06879d with identifier: 1987686
2026-03-27 22:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b35d02ca-c350-5ebb-9140-f1118f06879d with identifier: 1987686
2026-03-27 22:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b35d02ca-c350-5ebb-9140-f1118f06879d with identifier: 1987686 to the API
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b35d02ca-c350-5ebb-9140-f1118f06879d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90',
 'odometer': 139321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35d02ca-c350-5ebb-9140-f1118f06879d/b35d02ca-c350-5ebb-9140-f1118f06879d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/18f0ac09007d482ab5ed7b0f5c1064cd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 2.0 T6 PHEV INSCRIPTION AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987686%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [ayvens.be] INFO: Saving data for 1987686: {'created_time': 1774651686.65306, 'last_price_update_time': 1774651686.653072, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987686') HTTP/1.1" 204 0
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/10.jpg not downloaded yet
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc2490>
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/7.jpg saved to cache
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [ayvens.be] INFO: Found listing with ID: 1987689
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987689%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [ayvens.be] INFO: Scrape type for 1987689: 1
2026-03-27 22:48:06 [ayvens.be] INFO: Extracting data for car ID: 1987689
2026-03-27 22:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ece722-0369-57dc-ab92-5296e9e7ac97 with identifier: 1987689
2026-03-27 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ece722-0369-57dc-ab92-5296e9e7ac97 with scrape type 1
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/1.jpg not downloaded yet
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e510>
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/6.jpg saved to cache
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 1 pages/min), scraped 93 items (at 35 items/min)
2026-03-27 22:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-27 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/2.jpg not downloaded yet
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5554c10>
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/10.jpg saved to cache
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b0110>
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/8.jpg saved to cache
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45acd50>
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/5.jpg saved to cache
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/3.jpg not downloaded yet
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d57250d0>
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/9.jpg saved to cache
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bc050>
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/2.jpg saved to cache
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/4.jpg not downloaded yet
2026-03-27 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/5.jpg not downloaded yet
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56548d0>
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/1.jpg saved to cache
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/6.jpg not downloaded yet
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/7.jpg not downloaded yet
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4531b50>
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F06f37c69d5ad4a6e9eab97418c3abe42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/4.jpg saved to cache
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70
2026-03-27 22:48:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dac9ed5-895c-5c73-9bc2-064e7c818d70, skipping ID generation
2026-03-27 22:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with scrape type 1
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dac9ed5-895c-5c73-9bc2-064e7c818d70 sending to next pipeline
2026-03-27 22:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5dac9ed5-895c-5c73-9bc2-064e7c818d70, identifier: 1987687
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53a0b90>
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/2.jpg saved to cache
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/8.jpg not downloaded yet
2026-03-27 22:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with identifier: 1987687
2026-03-27 22:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with identifier: 1987687
2026-03-27 22:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5dac9ed5-895c-5c73-9bc2-064e7c818d70 with identifier: 1987687 to the API
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '5dac9ed5-895c-5c73-9bc2-064e7c818d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 133756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dac9ed5-895c-5c73-9bc2-064e7c818d70/5dac9ed5-895c-5c73-9bc2-064e7c818d70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/06f37c69d5ad4a6e9eab97418c3abe42/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 78 kWh P8 AWD Recharge R-Design',
 'transmission': 'automatic',
 'trim': '78 kWh P8 AWD Recharge R-Design',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987687%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [ayvens.be] INFO: Saving data for 1987687: {'created_time': 1774651688.907092, 'last_price_update_time': 1774651688.907105, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987687') HTTP/1.1" 204 0
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/9.jpg not downloaded yet
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/10.jpg not downloaded yet
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5430950>
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/3.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5655850>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/6.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fefd0>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/5.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [ayvens.be] INFO: Found listing with ID: 1987690
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987690%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [ayvens.be] INFO: Scrape type for 1987690: 1
2026-03-27 22:48:09 [ayvens.be] INFO: Extracting data for car ID: 1987690
2026-03-27 22:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c731918c-dce9-5b79-ba3f-c1462c6867ec with identifier: 1987690
2026-03-27 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c731918c-dce9-5b79-ba3f-c1462c6867ec with scrape type 1
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/1.jpg not downloaded yet
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/2.jpg not downloaded yet
2026-03-27 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556850>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/4.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b4d50>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/8.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b9190>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/7.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457f690>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/10.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/3.jpg not downloaded yet
2026-03-27 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/4.jpg not downloaded yet
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/5.jpg not downloaded yet
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56af710>
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F02b22779e25d461794cfbd172d12eec9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/9.jpg saved to cache
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3
2026-03-27 22:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3, skipping ID generation
2026-03-27 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with scrape type 1
2026-03-27 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 sending to next pipeline
2026-03-27 22:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3, identifier: 1987688
2026-03-27 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with identifier: 1987688
2026-03-27 22:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with identifier: 1987688
2026-03-27 22:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6bc2d8fa-ac78-58da-9b36-cc269c6911f3 with identifier: 1987688 to the API
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6bc2d8fa-ac78-58da-9b36-cc269c6911f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 142839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc2d8fa-ac78-58da-9b36-cc269c6911f3/6bc2d8fa-ac78-58da-9b36-cc269c6911f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/02b22779e25d461794cfbd172d12eec9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 T-GDI HYBRID FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI HYBRID FEEL AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987688%27 HTTP/1.1" 200 None
2026-03-27 22:48:10 [ayvens.be] INFO: Saving data for 1987688: {'created_time': 1774651690.422393, 'last_price_update_time': 1774651690.422404, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987688') HTTP/1.1" 204 0
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/6.jpg not downloaded yet
2026-03-27 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/7.jpg not downloaded yet
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c99d0>
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/1.jpg saved to cache
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e550>
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/3.jpg saved to cache
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5694250>
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/2.jpg saved to cache
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5443250>
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/4.jpg saved to cache
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/8.jpg not downloaded yet
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45944d0>
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/5.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457ddd0>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/6.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/9.jpg not downloaded yet
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/10.jpg not downloaded yet
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653290>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/7.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0a90>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/9.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [ayvens.be] INFO: Found listing with ID: 1987691
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987691%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [ayvens.be] INFO: Scrape type for 1987691: 1
2026-03-27 22:48:11 [ayvens.be] INFO: Extracting data for car ID: 1987691
2026-03-27 22:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with identifier: 1987691
2026-03-27 22:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with scrape type 1
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/1.jpg not downloaded yet
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/2.jpg not downloaded yet
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4598290>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/1.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/3.jpg not downloaded yet
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/4.jpg not downloaded yet
2026-03-27 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4594650>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/8.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed2d0>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F910f5f2f545c47ea82377ff6b27a53aa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/10.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9ece722-0369-57dc-ab92-5296e9e7ac97
2026-03-27 22:48:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9ece722-0369-57dc-ab92-5296e9e7ac97, skipping ID generation
2026-03-27 22:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ece722-0369-57dc-ab92-5296e9e7ac97 with scrape type 1
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9ece722-0369-57dc-ab92-5296e9e7ac97 sending to next pipeline
2026-03-27 22:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f9ece722-0369-57dc-ab92-5296e9e7ac97, identifier: 1987689
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b9f10>
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/3.jpg saved to cache
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/5.jpg not downloaded yet
2026-03-27 22:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f9ece722-0369-57dc-ab92-5296e9e7ac97 with identifier: 1987689
2026-03-27 22:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f9ece722-0369-57dc-ab92-5296e9e7ac97 with identifier: 1987689
2026-03-27 22:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f9ece722-0369-57dc-ab92-5296e9e7ac97 with identifier: 1987689 to the API
2026-03-27 22:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f9ece722-0369-57dc-ab92-5296e9e7ac97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 117682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ece722-0369-57dc-ab92-5296e9e7ac97/f9ece722-0369-57dc-ab92-5296e9e7ac97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/910f5f2f545c47ea82377ff6b27a53aa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987689%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [ayvens.be] INFO: Saving data for 1987689: {'created_time': 1774651692.210262, 'last_price_update_time': 1774651692.210274, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987689') HTTP/1.1" 204 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/6.jpg not downloaded yet
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/7.jpg not downloaded yet
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dcb90>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/2.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e3990>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/5.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541e850>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/4.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55515d0>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/6.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/8.jpg not downloaded yet
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/9.jpg not downloaded yet
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/10.jpg not downloaded yet
2026-03-27 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:12 [ayvens.be] INFO: Found listing with ID: 1987692
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987692%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [ayvens.be] INFO: Scrape type for 1987692: 1
2026-03-27 22:48:12 [ayvens.be] INFO: Extracting data for car ID: 1987692
2026-03-27 22:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6cc6b36-e146-5f13-97ea-6a687b7ff195 with identifier: 1987692
2026-03-27 22:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cc6b36-e146-5f13-97ea-6a687b7ff195 with scrape type 1
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/1.jpg not downloaded yet
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/2.jpg not downloaded yet
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4520a90>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/7.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569d890>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/2.jpg saved to cache
2026-03-27 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7ed0>
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/1.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e990>
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/3.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/3.jpg not downloaded yet
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5460e50>
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/9.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431a90>
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/10.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/4.jpg not downloaded yet
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/5.jpg not downloaded yet
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5695e50>
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/4.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dec90>
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F813ac7d958284efd9fe70f7da0a99755%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/8.jpg saved to cache
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c731918c-dce9-5b79-ba3f-c1462c6867ec
2026-03-27 22:48:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c731918c-dce9-5b79-ba3f-c1462c6867ec, skipping ID generation
2026-03-27 22:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c731918c-dce9-5b79-ba3f-c1462c6867ec with scrape type 1
2026-03-27 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c731918c-dce9-5b79-ba3f-c1462c6867ec sending to next pipeline
2026-03-27 22:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c731918c-dce9-5b79-ba3f-c1462c6867ec, identifier: 1987690
2026-03-27 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c731918c-dce9-5b79-ba3f-c1462c6867ec with identifier: 1987690
2026-03-27 22:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c731918c-dce9-5b79-ba3f-c1462c6867ec with identifier: 1987690
2026-03-27 22:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c731918c-dce9-5b79-ba3f-c1462c6867ec with identifier: 1987690 to the API
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c731918c-dce9-5b79-ba3f-c1462c6867ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 108188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c731918c-dce9-5b79-ba3f-c1462c6867ec/c731918c-dce9-5b79-ba3f-c1462c6867ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/813ac7d958284efd9fe70f7da0a99755/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 70KW CLEVER',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW CLEVER',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987690%27 HTTP/1.1" 200 None
2026-03-27 22:48:14 [ayvens.be] INFO: Saving data for 1987690: {'created_time': 1774651694.083475, 'last_price_update_time': 1774651694.083486, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987690') HTTP/1.1" 204 0
2026-03-27 22:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/6.jpg not downloaded yet
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5342a50>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/6.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45948d0>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/5.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d27d0>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/7.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ae7d0>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/9.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458ca50>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/10.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/7.jpg not downloaded yet
2026-03-27 22:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566b650>
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fc%252F2274853c9f8c4a89ae5495d42034e933%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/8.jpg saved to cache
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922
2026-03-27 22:48:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922, skipping ID generation
2026-03-27 22:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with scrape type 1
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 sending to next pipeline
2026-03-27 22:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922, identifier: 1987691
2026-03-27 22:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/8.jpg not downloaded yet
2026-03-27 22:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with identifier: 1987691
2026-03-27 22:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with identifier: 1987691
2026-03-27 22:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4cdb4cab-1e94-5295-8f36-0fcf1cc88922 with identifier: 1987691 to the API
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '4cdb4cab-1e94-5295-8f36-0fcf1cc88922',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'EV6',
 'odometer': 47414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cdb4cab-1e94-5295-8f36-0fcf1cc88922/4cdb4cab-1e94-5295-8f36-0fcf1cc88922_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fc/2274853c9f8c4a89ae5495d42034e933/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 BEV 77KWH GT LINE AUTO AWD',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH GT LINE AUTO AWD',
 'vin': None,
 'year': 2024}
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987691%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [ayvens.be] INFO: Saving data for 1987691: {'created_time': 1774651695.085489, 'last_price_update_time': 1774651695.085499, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987691') HTTP/1.1" 204 0
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0dd0>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/1.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/9.jpg not downloaded yet
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459b550>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/2.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564a90>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/3.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/10.jpg not downloaded yet
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [ayvens.be] INFO: Found listing with ID: 1987693
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987693%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [ayvens.be] INFO: Scrape type for 1987693: 1
2026-03-27 22:48:15 [ayvens.be] INFO: Extracting data for car ID: 1987693
2026-03-27 22:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with identifier: 1987693
2026-03-27 22:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with scrape type 1
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/1.jpg not downloaded yet
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5426990>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/4.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/2.jpg not downloaded yet
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/3.jpg not downloaded yet
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/4.jpg not downloaded yet
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5656b50>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/5.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b1f90>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/6.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/5.jpg not downloaded yet
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/6.jpg not downloaded yet
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569d910>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/7.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497990>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/9.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/7.jpg not downloaded yet
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/8.jpg not downloaded yet
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/9.jpg not downloaded yet
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/10.jpg not downloaded yet
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-27 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea3210>
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/8.jpg saved to cache
2026-03-27 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4e50>
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F77d6c69c8c1d4501b48c9aa025b25f33%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/10.jpg saved to cache
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6cc6b36-e146-5f13-97ea-6a687b7ff195
2026-03-27 22:48:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6cc6b36-e146-5f13-97ea-6a687b7ff195, skipping ID generation
2026-03-27 22:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cc6b36-e146-5f13-97ea-6a687b7ff195 with scrape type 1
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6cc6b36-e146-5f13-97ea-6a687b7ff195 sending to next pipeline
2026-03-27 22:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d6cc6b36-e146-5f13-97ea-6a687b7ff195, identifier: 1987692
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56add50>
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/2.jpg saved to cache
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56df890>
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/1.jpg saved to cache
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56551d0>
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/4.jpg saved to cache
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384310>
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/3.jpg saved to cache
2026-03-27 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d6cc6b36-e146-5f13-97ea-6a687b7ff195 with identifier: 1987692
2026-03-27 22:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d6cc6b36-e146-5f13-97ea-6a687b7ff195 with identifier: 1987692
2026-03-27 22:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d6cc6b36-e146-5f13-97ea-6a687b7ff195 with identifier: 1987692 to the API
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd6cc6b36-e146-5f13-97ea-6a687b7ff195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 45602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cc6b36-e146-5f13-97ea-6a687b7ff195/d6cc6b36-e146-5f13-97ea-6a687b7ff195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/77d6c69c8c1d4501b48c9aa025b25f33/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987692%27 HTTP/1.1" 200 None
2026-03-27 22:48:16 [ayvens.be] INFO: Saving data for 1987692: {'created_time': 1774651696.880711, 'last_price_update_time': 1774651696.880721, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987692') HTTP/1.1" 204 0
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568f710>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/6.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568eed0>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/9.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668bd0>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/10.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548550>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/5.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b3a10>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/8.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5684a90>
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F340a84e39d2b46f3909f269d631637cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/7.jpg saved to cache
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43
2026-03-27 22:48:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43, skipping ID generation
2026-03-27 22:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with scrape type 1
2026-03-27 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 sending to next pipeline
2026-03-27 22:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43, identifier: 1987693
2026-03-27 22:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with identifier: 1987693
2026-03-27 22:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with identifier: 1987693
2026-03-27 22:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43 with identifier: 1987693 to the API
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 78971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43/eb1362f0-7b9a-5c27-bd0c-a9ed8b553f43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/340a84e39d2b46f3909f269d631637cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987693%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [ayvens.be] INFO: Saving data for 1987693: {'created_time': 1774651698.098756, 'last_price_update_time': 1774651698.098766, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987693') HTTP/1.1" 204 0
2026-03-27 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:48:18 [ayvens.be] INFO: Found listing with ID: 1987694
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987694%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [ayvens.be] INFO: Scrape type for 1987694: 1
2026-03-27 22:48:18 [ayvens.be] INFO: Extracting data for car ID: 1987694
2026-03-27 22:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7407a81-e778-5b3b-9e93-09da2459d276 with identifier: 1987694
2026-03-27 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7407a81-e778-5b3b-9e93-09da2459d276 with scrape type 1
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/1.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/2.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/3.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/4.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/5.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/6.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/7.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/8.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/9.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/10.jpg not downloaded yet
2026-03-27 22:48:18 [ayvens.be] INFO: Found listing with ID: 1987695
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987695%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [ayvens.be] INFO: Scrape type for 1987695: 1
2026-03-27 22:48:18 [ayvens.be] INFO: Extracting data for car ID: 1987695
2026-03-27 22:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2891775-9cdc-5cd2-83dd-81d403d388c8 with identifier: 1987695
2026-03-27 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2891775-9cdc-5cd2-83dd-81d403d388c8 with scrape type 1
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/1.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/2.jpg not downloaded yet
2026-03-27 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/3.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/4.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/5.jpg not downloaded yet
2026-03-27 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/6.jpg not downloaded yet
2026-03-27 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/7.jpg not downloaded yet
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/8.jpg not downloaded yet
2026-03-27 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568f190>
2026-03-27 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/1.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/9.jpg not downloaded yet
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/10.jpg not downloaded yet
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [ayvens.be] INFO: Found listing with ID: 1987696
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987696%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [ayvens.be] INFO: Scrape type for 1987696: 1
2026-03-27 22:48:19 [ayvens.be] INFO: Extracting data for car ID: 1987696
2026-03-27 22:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 019cdef2-10e2-5be7-98cf-25d8a5b29edf with identifier: 1987696
2026-03-27 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf with scrape type 1
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/1.jpg not downloaded yet
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5687f50>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/5.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52cb150>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/3.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a91d0>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/2.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/2.jpg not downloaded yet
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/3.jpg not downloaded yet
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53497d0>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/4.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5585250>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/1.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431890>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/9.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5585710>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/2.jpg saved to cache
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/4.jpg not downloaded yet
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/5.jpg not downloaded yet
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/6.jpg not downloaded yet
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dcd10>
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/6.jpg saved to cache
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45add90>
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/7.jpg saved to cache
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5658b50>
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/8.jpg saved to cache
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4597150>
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F27bbefae4e094a65825ea3450378880a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/10.jpg saved to cache
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7407a81-e778-5b3b-9e93-09da2459d276
2026-03-27 22:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7407a81-e778-5b3b-9e93-09da2459d276, skipping ID generation
2026-03-27 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7407a81-e778-5b3b-9e93-09da2459d276 with scrape type 1
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7407a81-e778-5b3b-9e93-09da2459d276 sending to next pipeline
2026-03-27 22:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d7407a81-e778-5b3b-9e93-09da2459d276, identifier: 1987694
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5324750>
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/3.jpg saved to cache
2026-03-27 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d7407a81-e778-5b3b-9e93-09da2459d276 with identifier: 1987694
2026-03-27 22:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d7407a81-e778-5b3b-9e93-09da2459d276 with identifier: 1987694
2026-03-27 22:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d7407a81-e778-5b3b-9e93-09da2459d276 with identifier: 1987694 to the API
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd7407a81-e778-5b3b-9e93-09da2459d276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 67636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7407a81-e778-5b3b-9e93-09da2459d276/d7407a81-e778-5b3b-9e93-09da2459d276_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/27bbefae4e094a65825ea3450378880a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987694%27 HTTP/1.1" 200 None
2026-03-27 22:48:20 [ayvens.be] INFO: Saving data for 1987694: {'created_time': 1774651700.945809, 'last_price_update_time': 1774651700.945819, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987694') HTTP/1.1" 204 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/7.jpg not downloaded yet
2026-03-27 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/8.jpg not downloaded yet
2026-03-27 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52caf10>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/5.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a2750>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/6.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f4510>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/4.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a37d0>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/7.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3890>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/9.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f55d0>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/8.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/9.jpg not downloaded yet
2026-03-27 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/10.jpg not downloaded yet
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b6190>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252Fbfa9539300a14979bd42ed9c89416eb5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/10.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2891775-9cdc-5cd2-83dd-81d403d388c8
2026-03-27 22:48:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2891775-9cdc-5cd2-83dd-81d403d388c8, skipping ID generation
2026-03-27 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2891775-9cdc-5cd2-83dd-81d403d388c8 with scrape type 1
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2891775-9cdc-5cd2-83dd-81d403d388c8 sending to next pipeline
2026-03-27 22:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c2891775-9cdc-5cd2-83dd-81d403d388c8, identifier: 1987695
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fc750>
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/1.jpg saved to cache
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:21 [ayvens.be] INFO: Found listing with ID: 1987697
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987697%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [ayvens.be] INFO: Scrape type for 1987697: 1
2026-03-27 22:48:21 [ayvens.be] INFO: Extracting data for car ID: 1987697
2026-03-27 22:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with identifier: 1987697
2026-03-27 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with scrape type 1
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/1.jpg not downloaded yet
2026-03-27 22:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c2891775-9cdc-5cd2-83dd-81d403d388c8 with identifier: 1987695
2026-03-27 22:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c2891775-9cdc-5cd2-83dd-81d403d388c8 with identifier: 1987695
2026-03-27 22:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c2891775-9cdc-5cd2-83dd-81d403d388c8 with identifier: 1987695 to the API
2026-03-27 22:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c2891775-9cdc-5cd2-83dd-81d403d388c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 51122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2891775-9cdc-5cd2-83dd-81d403d388c8/c2891775-9cdc-5cd2-83dd-81d403d388c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/bfa9539300a14979bd42ed9c89416eb5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987695%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [ayvens.be] INFO: Saving data for 1987695: {'created_time': 1774651702.226123, 'last_price_update_time': 1774651702.226135, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987695') HTTP/1.1" 204 0
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/2.jpg not downloaded yet
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5d90>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/2.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547b390>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/3.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e710>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/4.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/3.jpg not downloaded yet
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/4.jpg not downloaded yet
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569f6d0>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/6.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668f10>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/5.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/5.jpg not downloaded yet
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/6.jpg not downloaded yet
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5110>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/8.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5659150>
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/7.jpg saved to cache
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/7.jpg not downloaded yet
2026-03-27 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/8.jpg not downloaded yet
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5694210>
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/10.jpg saved to cache
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554be90>
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F207e00199527495bb96a8ac81ab4c9e1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/9.jpg saved to cache
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf
2026-03-27 22:48:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 019cdef2-10e2-5be7-98cf-25d8a5b29edf, skipping ID generation
2026-03-27 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf with scrape type 1
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 019cdef2-10e2-5be7-98cf-25d8a5b29edf sending to next pipeline
2026-03-27 22:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 019cdef2-10e2-5be7-98cf-25d8a5b29edf, identifier: 1987696
2026-03-27 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 019cdef2-10e2-5be7-98cf-25d8a5b29edf with identifier: 1987696
2026-03-27 22:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 019cdef2-10e2-5be7-98cf-25d8a5b29edf with identifier: 1987696
2026-03-27 22:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 019cdef2-10e2-5be7-98cf-25d8a5b29edf with identifier: 1987696 to the API
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '019cdef2-10e2-5be7-98cf-25d8a5b29edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_019cdef2-10e2-5be7-98cf-25d8a5b29edf/019cdef2-10e2-5be7-98cf-25d8a5b29edf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/207e00199527495bb96a8ac81ab4c9e1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987696%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [ayvens.be] INFO: Saving data for 1987696: {'created_time': 1774651703.612169, 'last_price_update_time': 1774651703.61218, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987696') HTTP/1.1" 204 0
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/9.jpg not downloaded yet
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/10.jpg not downloaded yet
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [ayvens.be] INFO: Found listing with ID: 1987698
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987698%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [ayvens.be] INFO: Scrape type for 1987698: 1
2026-03-27 22:48:23 [ayvens.be] INFO: Extracting data for car ID: 1987698
2026-03-27 22:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcba77d-243c-5cfc-91e0-47aeaaff122f with identifier: 1987698
2026-03-27 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f with scrape type 1
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/1.jpg not downloaded yet
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/2.jpg not downloaded yet
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/3.jpg not downloaded yet
2026-03-27 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/4.jpg not downloaded yet
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/5.jpg not downloaded yet
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4532e50>
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/2.jpg saved to cache
2026-03-27 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454b990>
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/1.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/6.jpg not downloaded yet
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/7.jpg not downloaded yet
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/8.jpg not downloaded yet
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478e50>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/3.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7969950>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/4.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341610>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/6.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566eb90>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/5.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/9.jpg not downloaded yet
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5657150>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/7.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15350>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/1.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5695910>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/2.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/10.jpg not downloaded yet
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [ayvens.be] INFO: Found listing with ID: 1987699
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987699%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [ayvens.be] INFO: Scrape type for 1987699: 1
2026-03-27 22:48:24 [ayvens.be] INFO: Extracting data for car ID: 1987699
2026-03-27 22:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with identifier: 1987699
2026-03-27 22:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with scrape type 1
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/1.jpg not downloaded yet
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55677d0>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/9.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a56d0>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/3.jpg saved to cache
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/2.jpg not downloaded yet
2026-03-27 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/3.jpg not downloaded yet
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5432c10>
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/10.jpg saved to cache
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e24d0>
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/4.jpg saved to cache
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541f210>
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F1f39e35691d94ae39cea74971431c732%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/8.jpg saved to cache
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab
2026-03-27 22:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab, skipping ID generation
2026-03-27 22:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with scrape type 1
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c9ed06a-3822-51c4-aff1-d0db4571b1ab sending to next pipeline
2026-03-27 22:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab, identifier: 1987697
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7d50>
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/5.jpg saved to cache
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/4.jpg not downloaded yet
2026-03-27 22:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with identifier: 1987697
2026-03-27 22:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with identifier: 1987697
2026-03-27 22:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7c9ed06a-3822-51c4-aff1-d0db4571b1ab with identifier: 1987697 to the API
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7c9ed06a-3822-51c4-aff1-d0db4571b1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 HATCH DIESEL - 2019',
 'odometer': 126245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9ed06a-3822-51c4-aff1-d0db4571b1ab/7c9ed06a-3822-51c4-aff1-d0db4571b1ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/1f39e35691d94ae39cea74971431c732/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 HATCH DIESEL - 2019 116 d AdBlue',
 'transmission': 'manual',
 'trim': '116 d AdBlue',
 'vin': None,
 'year': 2020}
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987697%27 HTTP/1.1" 200 None
2026-03-27 22:48:25 [ayvens.be] INFO: Saving data for 1987697: {'created_time': 1774651705.913428, 'last_price_update_time': 1774651705.913437, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987697') HTTP/1.1" 204 0
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/5.jpg not downloaded yet
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5725790>
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/7.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a5a50>
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/6.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/6.jpg not downloaded yet
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/7.jpg not downloaded yet
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/8.jpg not downloaded yet
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/9.jpg not downloaded yet
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/10.jpg not downloaded yet
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504d50>
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/8.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:26 [ayvens.be] INFO: Found listing with ID: 1987700
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987700%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [ayvens.be] INFO: Scrape type for 1987700: 1
2026-03-27 22:48:26 [ayvens.be] INFO: Extracting data for car ID: 1987700
2026-03-27 22:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with identifier: 1987700
2026-03-27 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with scrape type 1
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/1.jpg not downloaded yet
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9290>
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/9.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8190>
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/1.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b3510>
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F28715ff3c37a4c25a1d31e7342219f29%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/10.jpg saved to cache
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f
2026-03-27 22:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dcba77d-243c-5cfc-91e0-47aeaaff122f, skipping ID generation
2026-03-27 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f with scrape type 1
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dcba77d-243c-5cfc-91e0-47aeaaff122f sending to next pipeline
2026-03-27 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8dcba77d-243c-5cfc-91e0-47aeaaff122f, identifier: 1987698
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/2.jpg not downloaded yet
2026-03-27 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8dcba77d-243c-5cfc-91e0-47aeaaff122f with identifier: 1987698
2026-03-27 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8dcba77d-243c-5cfc-91e0-47aeaaff122f with identifier: 1987698
2026-03-27 22:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8dcba77d-243c-5cfc-91e0-47aeaaff122f with identifier: 1987698 to the API
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8dcba77d-243c-5cfc-91e0-47aeaaff122f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 124569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcba77d-243c-5cfc-91e0-47aeaaff122f/8dcba77d-243c-5cfc-91e0-47aeaaff122f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/28715ff3c37a4c25a1d31e7342219f29/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.5 BLUEHDI 110 S&S BUSINESS LOUNGE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 110 S&S BUSINESS LOUNGE',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987698%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [ayvens.be] INFO: Saving data for 1987698: {'created_time': 1774651707.090145, 'last_price_update_time': 1774651707.090156, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987698') HTTP/1.1" 204 0
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e13f50>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/3.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fed10>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/2.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/3.jpg not downloaded yet
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/4.jpg not downloaded yet
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/5.jpg not downloaded yet
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/6.jpg not downloaded yet
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/7.jpg not downloaded yet
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457f110>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/5.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/8.jpg not downloaded yet
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5694ed0>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/6.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5479190>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/4.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/9.jpg not downloaded yet
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5396b90>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/9.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4567b90>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/10.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c1f90>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/8.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4567790>
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fcd2c1a9a2edb41f088835824b83170db%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/7.jpg saved to cache
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4
2026-03-27 22:48:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4, skipping ID generation
2026-03-27 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with scrape type 1
2026-03-27 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 sending to next pipeline
2026-03-27 22:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4, identifier: 1987699
2026-03-27 22:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with identifier: 1987699
2026-03-27 22:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with identifier: 1987699
2026-03-27 22:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1f1a932e-cdcb-50d1-908b-e4a35c3b13f4 with identifier: 1987699 to the API
2026-03-27 22:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1f1a932e-cdcb-50d1-908b-e4a35c3b13f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 196154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1a932e-cdcb-50d1-908b-e4a35c3b13f4/1f1a932e-cdcb-50d1-908b-e4a35c3b13f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/cd2c1a9a2edb41f088835824b83170db/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY 2.0TDI 55KW BMT CARGO',
 'transmission': 'manual',
 'trim': '2.0TDI 55KW BMT CARGO',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987699%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [ayvens.be] INFO: Saving data for 1987699: {'created_time': 1774651708.207252, 'last_price_update_time': 1774651708.207263, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987699') HTTP/1.1" 204 0
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/10.jpg not downloaded yet
2026-03-27 22:48:28 [ayvens.be] INFO: Found listing with ID: 1987701
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987701%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [ayvens.be] INFO: Scrape type for 1987701: 1
2026-03-27 22:48:28 [ayvens.be] INFO: Extracting data for car ID: 1987701
2026-03-27 22:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with identifier: 1987701
2026-03-27 22:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with scrape type 1
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/1.jpg not downloaded yet
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/2.jpg not downloaded yet
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/3.jpg not downloaded yet
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/4.jpg not downloaded yet
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/5.jpg not downloaded yet
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/6.jpg not downloaded yet
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/7.jpg not downloaded yet
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc2bd0>
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/1.jpg saved to cache
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/8.jpg not downloaded yet
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4584cd0>
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/2.jpg saved to cache
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fd010>
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/3.jpg saved to cache
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458d0d0>
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/5.jpg saved to cache
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/9.jpg not downloaded yet
2026-03-27 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/10.jpg not downloaded yet
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dec10>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/4.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ccb10>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/6.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4506450>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/7.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:29 [ayvens.be] INFO: Found listing with ID: 1987702
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987702%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [ayvens.be] INFO: Scrape type for 1987702: 1
2026-03-27 22:48:29 [ayvens.be] INFO: Extracting data for car ID: 1987702
2026-03-27 22:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7404a658-4a21-5f69-934c-47a5f26327b5 with identifier: 1987702
2026-03-27 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404a658-4a21-5f69-934c-47a5f26327b5 with scrape type 1
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/1.jpg not downloaded yet
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/2.jpg not downloaded yet
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5315350>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/8.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/3.jpg not downloaded yet
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/4.jpg not downloaded yet
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/5.jpg not downloaded yet
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5694950>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/1.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566b090>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/3.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/6.jpg not downloaded yet
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/7.jpg not downloaded yet
2026-03-27 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8cd0>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/2.jpg saved to cache
2026-03-27 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5565350>
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/4.jpg saved to cache
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458e590>
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/10.jpg saved to cache
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431410>
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/5.jpg saved to cache
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45655d0>
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F3c21a3965a2444e6b6812ee2d0926666%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/9.jpg saved to cache
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450
2026-03-27 22:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450, skipping ID generation
2026-03-27 22:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with scrape type 1
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 sending to next pipeline
2026-03-27 22:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450, identifier: 1987700
2026-03-27 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/8.jpg not downloaded yet
2026-03-27 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with identifier: 1987700
2026-03-27 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with identifier: 1987700
2026-03-27 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450 with identifier: 1987700 to the API
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT DIESEL - 2019',
 'odometer': 164546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450/8ac87dae-41b9-5f8f-8bd4-9adc4e3f7450_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/3c21a3965a2444e6b6812ee2d0926666/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT DIESEL - 2019 1.6 TDi SCR Style Business '
          'DSG',
 'transmission': 'automatic',
 'trim': '1.6 TDi SCR Style Business DSG',
 'vin': None,
 'year': 2019}
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987700%27 HTTP/1.1" 200 None
2026-03-27 22:48:30 [ayvens.be] INFO: Saving data for 1987700: {'created_time': 1774651710.864944, 'last_price_update_time': 1774651710.864954, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987700') HTTP/1.1" 204 0
2026-03-27 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/9.jpg not downloaded yet
2026-03-27 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/10.jpg not downloaded yet
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5427b50>
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/2.jpg saved to cache
2026-03-27 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553cd0>
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/1.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:31 [ayvens.be] INFO: Found listing with ID: 1987703
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987703%27 HTTP/1.1" 200 None
2026-03-27 22:48:31 [ayvens.be] INFO: Scrape type for 1987703: 1
2026-03-27 22:48:31 [ayvens.be] INFO: Extracting data for car ID: 1987703
2026-03-27 22:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f868c0e-23da-516c-92da-65bc11e7cf28 with identifier: 1987703
2026-03-27 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f868c0e-23da-516c-92da-65bc11e7cf28 with scrape type 1
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/1.jpg not downloaded yet
2026-03-27 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/2.jpg not downloaded yet
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5385c10>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/6.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a4410>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/7.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/3.jpg not downloaded yet
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/4.jpg not downloaded yet
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4561c10>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/3.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454a650>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/5.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c99d0>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/10.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ded0>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/8.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54425d0>
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F00273fc311914fae83d04a8141263ab4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/9.jpg saved to cache
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3
2026-03-27 22:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3, skipping ID generation
2026-03-27 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with scrape type 1
2026-03-27 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 sending to next pipeline
2026-03-27 22:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3, identifier: 1987701
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with identifier: 1987701
2026-03-27 22:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with identifier: 1987701
2026-03-27 22:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82ce5d83-ea68-5d17-a8df-3db0d175dbe3 with identifier: 1987701 to the API
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '82ce5d83-ea68-5d17-a8df-3db0d175dbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 127830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce5d83-ea68-5d17-a8df-3db0d175dbe3/82ce5d83-ea68-5d17-a8df-3db0d175dbe3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/00273fc311914fae83d04a8141263ab4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 2.0 ECOBLUE 110KW AUTO ACTIVE X',
 'transmission': 'automatic',
 'trim': '2.0 ECOBLUE 110KW AUTO ACTIVE X',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987701%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [ayvens.be] INFO: Saving data for 1987701: {'created_time': 1774651712.495188, 'last_price_update_time': 1774651712.495198, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987701') HTTP/1.1" 204 0
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/5.jpg not downloaded yet
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/6.jpg not downloaded yet
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c99d0>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/6.jpg saved to cache
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b0bd0>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/8.jpg saved to cache
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569e250>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/4.jpg saved to cache
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/7.jpg not downloaded yet
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/8.jpg not downloaded yet
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459d910>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/9.jpg saved to cache
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dcd50>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/7.jpg saved to cache
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/9.jpg not downloaded yet
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4585210>
2026-03-27 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa9bcc307c4104643a8ee1d06a4509adf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/10.jpg saved to cache
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7404a658-4a21-5f69-934c-47a5f26327b5
2026-03-27 22:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7404a658-4a21-5f69-934c-47a5f26327b5, skipping ID generation
2026-03-27 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404a658-4a21-5f69-934c-47a5f26327b5 with scrape type 1
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7404a658-4a21-5f69-934c-47a5f26327b5 sending to next pipeline
2026-03-27 22:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7404a658-4a21-5f69-934c-47a5f26327b5, identifier: 1987702
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/10.jpg not downloaded yet
2026-03-27 22:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7404a658-4a21-5f69-934c-47a5f26327b5 with identifier: 1987702
2026-03-27 22:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7404a658-4a21-5f69-934c-47a5f26327b5 with identifier: 1987702
2026-03-27 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7404a658-4a21-5f69-934c-47a5f26327b5 with identifier: 1987702 to the API
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7404a658-4a21-5f69-934c-47a5f26327b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 31078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a658-4a21-5f69-934c-47a5f26327b5/7404a658-4a21-5f69-934c-47a5f26327b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a9bcc307c4104643a8ee1d06a4509adf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987702%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [ayvens.be] INFO: Saving data for 1987702: {'created_time': 1774651713.543824, 'last_price_update_time': 1774651713.543835, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987702') HTTP/1.1" 204 0
2026-03-27 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:33 [ayvens.be] INFO: Found listing with ID: 1987704
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987704%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [ayvens.be] INFO: Scrape type for 1987704: 1
2026-03-27 22:48:33 [ayvens.be] INFO: Extracting data for car ID: 1987704
2026-03-27 22:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed5b051-bae4-5d86-9e04-f70c597027a9 with identifier: 1987704
2026-03-27 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed5b051-bae4-5d86-9e04-f70c597027a9 with scrape type 1
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/1.jpg not downloaded yet
2026-03-27 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7d42dd0>
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/2.jpg saved to cache
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0510>
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/1.jpg saved to cache
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/2.jpg not downloaded yet
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/3.jpg not downloaded yet
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556b50>
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/3.jpg saved to cache
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dc790>
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/4.jpg saved to cache
2026-03-27 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/4.jpg not downloaded yet
2026-03-27 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/5.jpg not downloaded yet
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/6.jpg not downloaded yet
2026-03-27 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/7.jpg not downloaded yet
2026-03-27 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/8.jpg not downloaded yet
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/9.jpg not downloaded yet
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ae4d0>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/6.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45331d0>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/5.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/10.jpg not downloaded yet
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5724f50>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/7.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b4890>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/9.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [ayvens.be] INFO: Found listing with ID: 1987705
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987705%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [ayvens.be] INFO: Scrape type for 1987705: 1
2026-03-27 22:48:34 [ayvens.be] INFO: Extracting data for car ID: 1987705
2026-03-27 22:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328d436d-18d8-54ef-8966-5b1f91a09420 with identifier: 1987705
2026-03-27 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328d436d-18d8-54ef-8966-5b1f91a09420 with scrape type 1
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/1.jpg not downloaded yet
2026-03-27 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/2.jpg not downloaded yet
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56697d0>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/8.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d0f50>
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa98b3320f873494ca608bb37366e5176%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/10.jpg saved to cache
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f868c0e-23da-516c-92da-65bc11e7cf28
2026-03-27 22:48:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f868c0e-23da-516c-92da-65bc11e7cf28, skipping ID generation
2026-03-27 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f868c0e-23da-516c-92da-65bc11e7cf28 with scrape type 1
2026-03-27 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f868c0e-23da-516c-92da-65bc11e7cf28 sending to next pipeline
2026-03-27 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f868c0e-23da-516c-92da-65bc11e7cf28, identifier: 1987703
2026-03-27 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f868c0e-23da-516c-92da-65bc11e7cf28 with identifier: 1987703
2026-03-27 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f868c0e-23da-516c-92da-65bc11e7cf28 with identifier: 1987703
2026-03-27 22:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f868c0e-23da-516c-92da-65bc11e7cf28 with identifier: 1987703 to the API
2026-03-27 22:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4f868c0e-23da-516c-92da-65bc11e7cf28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 147610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f868c0e-23da-516c-92da-65bc11e7cf28/4f868c0e-23da-516c-92da-65bc11e7cf28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a98b3320f873494ca608bb37366e5176/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D AWD GEARTRONIC INSCRIPTION',
 'transmission': 'automatic',
 'trim': '2.0 B4 D AWD GEARTRONIC INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987703%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [ayvens.be] INFO: Saving data for 1987703: {'created_time': 1774651715.181593, 'last_price_update_time': 1774651715.181603, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987703') HTTP/1.1" 204 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/3.jpg not downloaded yet
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/4.jpg not downloaded yet
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d2190>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/1.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/5.jpg not downloaded yet
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/6.jpg not downloaded yet
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1c90>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/5.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5424610>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/6.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e4b50>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/2.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5565650>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/7.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/7.jpg not downloaded yet
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/8.jpg not downloaded yet
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f6550>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/3.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4551e10>
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/4.jpg saved to cache
2026-03-27 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/9.jpg not downloaded yet
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/10.jpg not downloaded yet
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569b450>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/9.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457f450>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/8.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568cd50>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/1.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [ayvens.be] INFO: Found listing with ID: 1987706
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987706%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [ayvens.be] INFO: Scrape type for 1987706: 1
2026-03-27 22:48:36 [ayvens.be] INFO: Extracting data for car ID: 1987706
2026-03-27 22:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9f85b3-9161-5609-ba55-f75a6e312717 with identifier: 1987706
2026-03-27 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f85b3-9161-5609-ba55-f75a6e312717 with scrape type 1
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/1.jpg not downloaded yet
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e4890>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/2.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fde50>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/3.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/2.jpg not downloaded yet
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/3.jpg not downloaded yet
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4586790>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F98f01d409ed745b48a68a1ca2f882082%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/10.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ed5b051-bae4-5d86-9e04-f70c597027a9
2026-03-27 22:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed5b051-bae4-5d86-9e04-f70c597027a9, skipping ID generation
2026-03-27 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed5b051-bae4-5d86-9e04-f70c597027a9 with scrape type 1
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ed5b051-bae4-5d86-9e04-f70c597027a9 sending to next pipeline
2026-03-27 22:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6ed5b051-bae4-5d86-9e04-f70c597027a9, identifier: 1987704
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e3819e10>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/5.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d0090>
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/6.jpg saved to cache
2026-03-27 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6ed5b051-bae4-5d86-9e04-f70c597027a9 with identifier: 1987704
2026-03-27 22:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6ed5b051-bae4-5d86-9e04-f70c597027a9 with identifier: 1987704
2026-03-27 22:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6ed5b051-bae4-5d86-9e04-f70c597027a9 with identifier: 1987704 to the API
2026-03-27 22:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6ed5b051-bae4-5d86-9e04-f70c597027a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 78222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed5b051-bae4-5d86-9e04-f70c597027a9/6ed5b051-bae4-5d86-9e04-f70c597027a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/98f01d409ed745b48a68a1ca2f882082/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM CORE',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987704%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [ayvens.be] INFO: Saving data for 1987704: {'created_time': 1774651717.129063, 'last_price_update_time': 1774651717.129072, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987704') HTTP/1.1" 204 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/4.jpg not downloaded yet
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5427d50>
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/4.jpg saved to cache
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ac0d0>
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/7.jpg saved to cache
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/5.jpg not downloaded yet
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56916d0>
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/8.jpg saved to cache
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5725c10>
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/9.jpg saved to cache
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/6.jpg not downloaded yet
2026-03-27 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/7.jpg not downloaded yet
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/8.jpg not downloaded yet
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/9.jpg not downloaded yet
2026-03-27 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/10.jpg not downloaded yet
2026-03-27 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:37 [ayvens.be] INFO: Found listing with ID: 1987707
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987707%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [ayvens.be] INFO: Scrape type for 1987707: 1
2026-03-27 22:48:37 [ayvens.be] INFO: Extracting data for car ID: 1987707
2026-03-27 22:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5799b22-b15b-5337-8595-12be0a264983 with identifier: 1987707
2026-03-27 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5799b22-b15b-5337-8595-12be0a264983 with scrape type 1
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/1.jpg not downloaded yet
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/2.jpg not downloaded yet
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/3.jpg not downloaded yet
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ca010>
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5f20c66ab4224c97907ecee3953abf1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/10.jpg saved to cache
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 328d436d-18d8-54ef-8966-5b1f91a09420
2026-03-27 22:48:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 328d436d-18d8-54ef-8966-5b1f91a09420, skipping ID generation
2026-03-27 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328d436d-18d8-54ef-8966-5b1f91a09420 with scrape type 1
2026-03-27 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 328d436d-18d8-54ef-8966-5b1f91a09420 sending to next pipeline
2026-03-27 22:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328d436d-18d8-54ef-8966-5b1f91a09420, identifier: 1987705
2026-03-27 22:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328d436d-18d8-54ef-8966-5b1f91a09420 with identifier: 1987705
2026-03-27 22:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328d436d-18d8-54ef-8966-5b1f91a09420 with identifier: 1987705
2026-03-27 22:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328d436d-18d8-54ef-8966-5b1f91a09420 with identifier: 1987705 to the API
2026-03-27 22:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '328d436d-18d8-54ef-8966-5b1f91a09420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 25611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328d436d-18d8-54ef-8966-5b1f91a09420/328d436d-18d8-54ef-8966-5b1f91a09420_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5f20c66ab4224c97907ecee3953abf1a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987705%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [ayvens.be] INFO: Saving data for 1987705: {'created_time': 1774651718.210357, 'last_price_update_time': 1774651718.210369, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987705') HTTP/1.1" 204 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/4.jpg not downloaded yet
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/5.jpg not downloaded yet
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45506d0>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/1.jpg saved to cache
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4526c10>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/2.jpg saved to cache
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/6.jpg not downloaded yet
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/7.jpg not downloaded yet
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2790>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/4.jpg saved to cache
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/8.jpg not downloaded yet
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/9.jpg not downloaded yet
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af890>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/3.jpg saved to cache
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7057250>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/7.jpg saved to cache
2026-03-27 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524f50>
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/5.jpg saved to cache
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/10.jpg not downloaded yet
2026-03-27 22:48:39 [ayvens.be] INFO: Found listing with ID: 1987708
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987708%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [ayvens.be] INFO: Scrape type for 1987708: 1
2026-03-27 22:48:39 [ayvens.be] INFO: Extracting data for car ID: 1987708
2026-03-27 22:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abef136e-f689-5965-9d10-fbd8028e4e5a with identifier: 1987708
2026-03-27 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abef136e-f689-5965-9d10-fbd8028e4e5a with scrape type 1
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/1.jpg not downloaded yet
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ff910>
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/6.jpg saved to cache
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567450>
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/8.jpg saved to cache
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540e350>
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/10.jpg saved to cache
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54970d0>
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F81fc401f378a48edbfb4691c5620b069%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/9.jpg saved to cache
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f9f85b3-9161-5609-ba55-f75a6e312717
2026-03-27 22:48:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f9f85b3-9161-5609-ba55-f75a6e312717, skipping ID generation
2026-03-27 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f85b3-9161-5609-ba55-f75a6e312717 with scrape type 1
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f9f85b3-9161-5609-ba55-f75a6e312717 sending to next pipeline
2026-03-27 22:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f9f85b3-9161-5609-ba55-f75a6e312717, identifier: 1987706
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/2.jpg not downloaded yet
2026-03-27 22:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f9f85b3-9161-5609-ba55-f75a6e312717 with identifier: 1987706
2026-03-27 22:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f9f85b3-9161-5609-ba55-f75a6e312717 with identifier: 1987706
2026-03-27 22:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f9f85b3-9161-5609-ba55-f75a6e312717 with identifier: 1987706 to the API
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9f9f85b3-9161-5609-ba55-f75a6e312717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 198084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f85b3-9161-5609-ba55-f75a6e312717/9f9f85b3-9161-5609-ba55-f75a6e312717_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/81fc401f378a48edbfb4691c5620b069/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 220 D 4MATIC DCT',
 'transmission': 'automatic',
 'trim': '2.0 GLB 220 D 4MATIC DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987706%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [ayvens.be] INFO: Saving data for 1987706: {'created_time': 1774651719.93707, 'last_price_update_time': 1774651719.937081, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987706') HTTP/1.1" 204 0
2026-03-27 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/3.jpg not downloaded yet
2026-03-27 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/4.jpg not downloaded yet
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/5.jpg not downloaded yet
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/6.jpg not downloaded yet
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/7.jpg not downloaded yet
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/8.jpg not downloaded yet
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/9.jpg not downloaded yet
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45aebd0>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/1.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753dbd0>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/2.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/10.jpg not downloaded yet
2026-03-27 22:48:40 [ayvens.be] INFO: Found listing with ID: 1987709
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987709%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [ayvens.be] INFO: Scrape type for 1987709: 1
2026-03-27 22:48:40 [ayvens.be] INFO: Extracting data for car ID: 1987709
2026-03-27 22:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bba111-54ab-5800-b8e3-199e40392846 with identifier: 1987709
2026-03-27 22:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bba111-54ab-5800-b8e3-199e40392846 with scrape type 1
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/1.jpg not downloaded yet
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fde10>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/4.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5f50>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/5.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c9fd0>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/3.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571bd90>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/7.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ad250>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/6.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56274d0>
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/10.jpg saved to cache
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/2.jpg not downloaded yet
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/3.jpg not downloaded yet
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/4.jpg not downloaded yet
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/5.jpg not downloaded yet
2026-03-27 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/6.jpg not downloaded yet
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/7.jpg not downloaded yet
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/8.jpg not downloaded yet
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/9.jpg not downloaded yet
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/10.jpg not downloaded yet
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea1250>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/3.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56eb750>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/2.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4581890>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/4.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5479f10>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/5.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:41 [ayvens.be] INFO: Found listing with ID: 1987710
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987710%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [ayvens.be] INFO: Scrape type for 1987710: 1
2026-03-27 22:48:41 [ayvens.be] INFO: Extracting data for car ID: 1987710
2026-03-27 22:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94441be2-e45c-51df-9dd9-00cf2573461a with identifier: 1987710
2026-03-27 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94441be2-e45c-51df-9dd9-00cf2573461a with scrape type 1
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/1.jpg not downloaded yet
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f390>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/8.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7053950>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/1.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b24d0>
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F13d72b4bc5b3445f8b18f0a7befbeac4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/9.jpg saved to cache
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5799b22-b15b-5337-8595-12be0a264983
2026-03-27 22:48:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5799b22-b15b-5337-8595-12be0a264983, skipping ID generation
2026-03-27 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5799b22-b15b-5337-8595-12be0a264983 with scrape type 1
2026-03-27 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5799b22-b15b-5337-8595-12be0a264983 sending to next pipeline
2026-03-27 22:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5799b22-b15b-5337-8595-12be0a264983, identifier: 1987707
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/2.jpg not downloaded yet
2026-03-27 22:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5799b22-b15b-5337-8595-12be0a264983 with identifier: 1987707
2026-03-27 22:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5799b22-b15b-5337-8595-12be0a264983 with identifier: 1987707
2026-03-27 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5799b22-b15b-5337-8595-12be0a264983 with identifier: 1987707 to the API
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e5799b22-b15b-5337-8595-12be0a264983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 129062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5799b22-b15b-5337-8595-12be0a264983/e5799b22-b15b-5337-8595-12be0a264983_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/13d72b4bc5b3445f8b18f0a7befbeac4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987707%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [ayvens.be] INFO: Saving data for 1987707: {'created_time': 1774651722.408818, 'last_price_update_time': 1774651722.408828, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987707') HTTP/1.1" 204 0
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/3.jpg not downloaded yet
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/4.jpg not downloaded yet
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/5.jpg not downloaded yet
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/6.jpg not downloaded yet
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/7.jpg not downloaded yet
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/8.jpg not downloaded yet
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5326550>
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/10.jpg saved to cache
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5584d50>
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/3.jpg saved to cache
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0810>
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/1.jpg saved to cache
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2e50>
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/2.jpg saved to cache
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/9.jpg not downloaded yet
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/10.jpg not downloaded yet
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:42 [ayvens.be] INFO: Found listing with ID: 1987711
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987711%27 HTTP/1.1" 200 None
2026-03-27 22:48:42 [ayvens.be] INFO: Scrape type for 1987711: 1
2026-03-27 22:48:42 [ayvens.be] INFO: Extracting data for car ID: 1987711
2026-03-27 22:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417dda31-ed67-563e-a12c-59f1739ccca1 with identifier: 1987711
2026-03-27 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417dda31-ed67-563e-a12c-59f1739ccca1 with scrape type 1
2026-03-27 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/1.jpg not downloaded yet
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5726cd0>
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/6.jpg saved to cache
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459dad0>
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/7.jpg saved to cache
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1390>
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/8.jpg saved to cache
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15550>
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Face078b9c45e497eb71a20213b0efa76%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/9.jpg saved to cache
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abef136e-f689-5965-9d10-fbd8028e4e5a
2026-03-27 22:48:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abef136e-f689-5965-9d10-fbd8028e4e5a, skipping ID generation
2026-03-27 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abef136e-f689-5965-9d10-fbd8028e4e5a with scrape type 1
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abef136e-f689-5965-9d10-fbd8028e4e5a sending to next pipeline
2026-03-27 22:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abef136e-f689-5965-9d10-fbd8028e4e5a, identifier: 1987708
2026-03-27 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abef136e-f689-5965-9d10-fbd8028e4e5a with identifier: 1987708
2026-03-27 22:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abef136e-f689-5965-9d10-fbd8028e4e5a with identifier: 1987708
2026-03-27 22:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abef136e-f689-5965-9d10-fbd8028e4e5a with identifier: 1987708 to the API
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'abef136e-f689-5965-9d10-fbd8028e4e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-Klasse',
 'odometer': 190883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abef136e-f689-5965-9d10-fbd8028e4e5a/abef136e-f689-5965-9d10-fbd8028e4e5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/ace078b9c45e497eb71a20213b0efa76/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-Klasse 1.6 E 200 D BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '1.6 E 200 D BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2020}
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987708%27 HTTP/1.1" 200 None
2026-03-27 22:48:43 [ayvens.be] INFO: Saving data for 1987708: {'created_time': 1774651723.824139, 'last_price_update_time': 1774651723.824149, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987708') HTTP/1.1" 204 0
2026-03-27 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/2.jpg not downloaded yet
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/3.jpg not downloaded yet
2026-03-27 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3b90>
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/10.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b37d0>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/9.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534bb50>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/7.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dc4d0>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/4.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534b090>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/8.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4564c50>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/6.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/4.jpg not downloaded yet
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/5.jpg not downloaded yet
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5616d10>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F55712304d9ba4895ad982da9301248b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/5.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26bba111-54ab-5800-b8e3-199e40392846
2026-03-27 22:48:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26bba111-54ab-5800-b8e3-199e40392846, skipping ID generation
2026-03-27 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bba111-54ab-5800-b8e3-199e40392846 with scrape type 1
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26bba111-54ab-5800-b8e3-199e40392846 sending to next pipeline
2026-03-27 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26bba111-54ab-5800-b8e3-199e40392846, identifier: 1987709
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524890>
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/1.jpg saved to cache
2026-03-27 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26bba111-54ab-5800-b8e3-199e40392846 with identifier: 1987709
2026-03-27 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26bba111-54ab-5800-b8e3-199e40392846 with identifier: 1987709
2026-03-27 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26bba111-54ab-5800-b8e3-199e40392846 with identifier: 1987709 to the API
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26bba111-54ab-5800-b8e3-199e40392846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 50072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bba111-54ab-5800-b8e3-199e40392846/26bba111-54ab-5800-b8e3-199e40392846_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/55712304d9ba4895ad982da9301248b3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987709%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [ayvens.be] INFO: Saving data for 1987709: {'created_time': 1774651725.103145, 'last_price_update_time': 1774651725.103155, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987709') HTTP/1.1" 204 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/6.jpg not downloaded yet
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/7.jpg not downloaded yet
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/8.jpg not downloaded yet
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/9.jpg not downloaded yet
2026-03-27 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/10.jpg not downloaded yet
2026-03-27 22:48:45 [ayvens.be] INFO: Found listing with ID: 1987712
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987712%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [ayvens.be] INFO: Scrape type for 1987712: 1
2026-03-27 22:48:45 [ayvens.be] INFO: Extracting data for car ID: 1987712
2026-03-27 22:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411d111b-d216-5945-bdfb-6277dd78caf2 with identifier: 1987712
2026-03-27 22:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411d111b-d216-5945-bdfb-6277dd78caf2 with scrape type 1
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/1.jpg not downloaded yet
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/2.jpg not downloaded yet
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15290>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/3.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d6410>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/2.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c0cd0>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/5.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c2190>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/4.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d316d0>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/6.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d5610>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/7.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549fc10>
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/9.jpg saved to cache
2026-03-27 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/3.jpg not downloaded yet
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c5250>
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/8.jpg saved to cache
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/4.jpg not downloaded yet
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/5.jpg not downloaded yet
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/6.jpg not downloaded yet
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/7.jpg not downloaded yet
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/8.jpg not downloaded yet
2026-03-27 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/9.jpg not downloaded yet
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/10.jpg not downloaded yet
2026-03-27 22:48:46 [ayvens.be] INFO: Found listing with ID: 1987713
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987713%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [ayvens.be] INFO: Scrape type for 1987713: 1
2026-03-27 22:48:46 [ayvens.be] INFO: Extracting data for car ID: 1987713
2026-03-27 22:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa0f78dd-5e0e-5b76-a5b8-51add4483323 with identifier: 1987713
2026-03-27 22:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0f78dd-5e0e-5b76-a5b8-51add4483323 with scrape type 1
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/1.jpg not downloaded yet
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/2.jpg not downloaded yet
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c9990>
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F565a85495711454db927bcbac011fa69%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/10.jpg saved to cache
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94441be2-e45c-51df-9dd9-00cf2573461a
2026-03-27 22:48:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94441be2-e45c-51df-9dd9-00cf2573461a, skipping ID generation
2026-03-27 22:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94441be2-e45c-51df-9dd9-00cf2573461a with scrape type 1
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94441be2-e45c-51df-9dd9-00cf2573461a sending to next pipeline
2026-03-27 22:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 94441be2-e45c-51df-9dd9-00cf2573461a, identifier: 1987710
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e10990>
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/1.jpg saved to cache
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d33050>
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/2.jpg saved to cache
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/3.jpg not downloaded yet
2026-03-27 22:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 94441be2-e45c-51df-9dd9-00cf2573461a with identifier: 1987710
2026-03-27 22:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 94441be2-e45c-51df-9dd9-00cf2573461a with identifier: 1987710
2026-03-27 22:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 94441be2-e45c-51df-9dd9-00cf2573461a with identifier: 1987710 to the API
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '94441be2-e45c-51df-9dd9-00cf2573461a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 121860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94441be2-e45c-51df-9dd9-00cf2573461a/94441be2-e45c-51df-9dd9-00cf2573461a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/565a85495711454db927bcbac011fa69/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM CORE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 MOMENTUM CORE AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987710%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [ayvens.be] INFO: Saving data for 1987710: {'created_time': 1774651727.008722, 'last_price_update_time': 1774651727.008733, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987710') HTTP/1.1" 204 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/4.jpg not downloaded yet
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ea450>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/3.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4506210>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/7.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5395bd0>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/5.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fdf10>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/6.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505d50>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/4.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/5.jpg not downloaded yet
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/6.jpg not downloaded yet
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/7.jpg not downloaded yet
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/8.jpg not downloaded yet
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/9.jpg not downloaded yet
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/10.jpg not downloaded yet
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af810>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/10.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [ayvens.be] INFO: Found listing with ID: 1987714
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987714%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [ayvens.be] INFO: Scrape type for 1987714: 1
2026-03-27 22:48:47 [ayvens.be] INFO: Extracting data for car ID: 1987714
2026-03-27 22:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64c0e49-3d95-58c2-a276-2d465d866219 with identifier: 1987714
2026-03-27 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64c0e49-3d95-58c2-a276-2d465d866219 with scrape type 1
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/1.jpg not downloaded yet
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4560250>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/9.jpg saved to cache
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/2.jpg not downloaded yet
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/3.jpg not downloaded yet
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7d42dd0>
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/2.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384110>
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/4.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549ed10>
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/1.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2fdd0>
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/5.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5654c50>
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F46c50d871b97461da4beec5e537b63ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/8.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 417dda31-ed67-563e-a12c-59f1739ccca1
2026-03-27 22:48:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 417dda31-ed67-563e-a12c-59f1739ccca1, skipping ID generation
2026-03-27 22:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417dda31-ed67-563e-a12c-59f1739ccca1 with scrape type 1
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 417dda31-ed67-563e-a12c-59f1739ccca1 sending to next pipeline
2026-03-27 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 417dda31-ed67-563e-a12c-59f1739ccca1, identifier: 1987711
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5430f50>
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/3.jpg saved to cache
2026-03-27 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 417dda31-ed67-563e-a12c-59f1739ccca1 with identifier: 1987711
2026-03-27 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 417dda31-ed67-563e-a12c-59f1739ccca1 with identifier: 1987711
2026-03-27 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 417dda31-ed67-563e-a12c-59f1739ccca1 with identifier: 1987711 to the API
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '417dda31-ed67-563e-a12c-59f1739ccca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 126234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417dda31-ed67-563e-a12c-59f1739ccca1/417dda31-ed67-563e-a12c-59f1739ccca1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/46c50d871b97461da4beec5e537b63ec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987711%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [ayvens.be] INFO: Saving data for 1987711: {'created_time': 1774651729.047629, 'last_price_update_time': 1774651729.047639, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987711') HTTP/1.1" 204 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/4.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/5.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/6.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/7.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/8.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/9.jpg not downloaded yet
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/10.jpg not downloaded yet
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea3d50>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/3.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45650d0>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/2.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:49 [ayvens.be] INFO: Found listing with ID: 1987715
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987715%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [ayvens.be] INFO: Scrape type for 1987715: 1
2026-03-27 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1987715
2026-03-27 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afce20e0-0f9d-5532-9419-4f1d72af1645 with identifier: 1987715
2026-03-27 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afce20e0-0f9d-5532-9419-4f1d72af1645 with scrape type 1
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/1.jpg not downloaded yet
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5496dd0>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/1.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/2.jpg not downloaded yet
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/3.jpg not downloaded yet
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5658710>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/6.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549d490>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/10.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4580290>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/9.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454bd50>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/7.jpg saved to cache
2026-03-27 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54abf90>
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F7c9ed476b0314c6fb38f31368be17cfc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/8.jpg saved to cache
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 411d111b-d216-5945-bdfb-6277dd78caf2
2026-03-27 22:48:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 411d111b-d216-5945-bdfb-6277dd78caf2, skipping ID generation
2026-03-27 22:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411d111b-d216-5945-bdfb-6277dd78caf2 with scrape type 1
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 411d111b-d216-5945-bdfb-6277dd78caf2 sending to next pipeline
2026-03-27 22:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 411d111b-d216-5945-bdfb-6277dd78caf2, identifier: 1987712
2026-03-27 22:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 411d111b-d216-5945-bdfb-6277dd78caf2 with identifier: 1987712
2026-03-27 22:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 411d111b-d216-5945-bdfb-6277dd78caf2 with identifier: 1987712
2026-03-27 22:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 411d111b-d216-5945-bdfb-6277dd78caf2 with identifier: 1987712 to the API
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '411d111b-d216-5945-bdfb-6277dd78caf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 102015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_411d111b-d216-5945-bdfb-6277dd78caf2/411d111b-d216-5945-bdfb-6277dd78caf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/7c9ed476b0314c6fb38f31368be17cfc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 HEV PREMIUM PLUS CVT',
 'transmission': 'automatic',
 'trim': '2.5 HEV PREMIUM PLUS CVT',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987712%27 HTTP/1.1" 200 None
2026-03-27 22:48:50 [ayvens.be] INFO: Saving data for 1987712: {'created_time': 1774651730.548032, 'last_price_update_time': 1774651730.548042, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987712') HTTP/1.1" 204 0
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/4.jpg not downloaded yet
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/5.jpg not downloaded yet
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e01d0>
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/4.jpg saved to cache
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d23d0>
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/2.jpg saved to cache
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f5e90>
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/1.jpg saved to cache
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/6.jpg not downloaded yet
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/7.jpg not downloaded yet
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5655d90>
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/5.jpg saved to cache
2026-03-27 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5615050>
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/7.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/8.jpg not downloaded yet
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/9.jpg not downloaded yet
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c1f10>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/4.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549fbd0>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/3.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3290>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/6.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54424d0>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/9.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4564d50>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/10.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/10.jpg not downloaded yet
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [ayvens.be] INFO: Found listing with ID: 1987716
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987716%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [ayvens.be] INFO: Scrape type for 1987716: 1
2026-03-27 22:48:51 [ayvens.be] INFO: Extracting data for car ID: 1987716
2026-03-27 22:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0965d552-f195-5b85-8fac-abf90f4aea94 with identifier: 1987716
2026-03-27 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0965d552-f195-5b85-8fac-abf90f4aea94 with scrape type 1
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/1.jpg not downloaded yet
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/2.jpg not downloaded yet
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a7150>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/5.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557950>
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F658eebdf733b45f6851dc7bdb550a082%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/8.jpg saved to cache
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa0f78dd-5e0e-5b76-a5b8-51add4483323
2026-03-27 22:48:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa0f78dd-5e0e-5b76-a5b8-51add4483323, skipping ID generation
2026-03-27 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0f78dd-5e0e-5b76-a5b8-51add4483323 with scrape type 1
2026-03-27 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa0f78dd-5e0e-5b76-a5b8-51add4483323 sending to next pipeline
2026-03-27 22:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa0f78dd-5e0e-5b76-a5b8-51add4483323, identifier: 1987713
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa0f78dd-5e0e-5b76-a5b8-51add4483323 with identifier: 1987713
2026-03-27 22:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa0f78dd-5e0e-5b76-a5b8-51add4483323 with identifier: 1987713
2026-03-27 22:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa0f78dd-5e0e-5b76-a5b8-51add4483323 with identifier: 1987713 to the API
2026-03-27 22:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'aa0f78dd-5e0e-5b76-a5b8-51add4483323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 72644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f78dd-5e0e-5b76-a5b8-51add4483323/aa0f78dd-5e0e-5b76-a5b8-51add4483323_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/658eebdf733b45f6851dc7bdb550a082/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987713%27 HTTP/1.1" 200 None
2026-03-27 22:48:52 [ayvens.be] INFO: Saving data for 1987713: {'created_time': 1774651732.115499, 'last_price_update_time': 1774651732.115512, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987713') HTTP/1.1" 204 0
2026-03-27 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/3.jpg not downloaded yet
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/4.jpg not downloaded yet
2026-03-27 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f5f90>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/6.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5315890>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/10.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569dd50>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/1.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d565a750>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/7.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/5.jpg not downloaded yet
2026-03-27 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/6.jpg not downloaded yet
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560c190>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/8.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ebc10>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F29678ae3e3dd4a499179269abf91df11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/9.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a64c0e49-3d95-58c2-a276-2d465d866219
2026-03-27 22:48:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a64c0e49-3d95-58c2-a276-2d465d866219, skipping ID generation
2026-03-27 22:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64c0e49-3d95-58c2-a276-2d465d866219 with scrape type 1
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a64c0e49-3d95-58c2-a276-2d465d866219 sending to next pipeline
2026-03-27 22:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a64c0e49-3d95-58c2-a276-2d465d866219, identifier: 1987714
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5372c50>
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/2.jpg saved to cache
2026-03-27 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a64c0e49-3d95-58c2-a276-2d465d866219 with identifier: 1987714
2026-03-27 22:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a64c0e49-3d95-58c2-a276-2d465d866219 with identifier: 1987714
2026-03-27 22:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a64c0e49-3d95-58c2-a276-2d465d866219 with identifier: 1987714 to the API
2026-03-27 22:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a64c0e49-3d95-58c2-a276-2d465d866219',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 133884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64c0e49-3d95-58c2-a276-2d465d866219/a64c0e49-3d95-58c2-a276-2d465d866219_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/29678ae3e3dd4a499179269abf91df11/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 180 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987714%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [ayvens.be] INFO: Saving data for 1987714: {'created_time': 1774651733.24998, 'last_price_update_time': 1774651733.249994, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987714') HTTP/1.1" 204 0
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/7.jpg not downloaded yet
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/8.jpg not downloaded yet
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52beb10>
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/5.jpg saved to cache
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4582d90>
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/4.jpg saved to cache
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/9.jpg not downloaded yet
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/10.jpg not downloaded yet
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541a010>
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/3.jpg saved to cache
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [ayvens.be] INFO: Found listing with ID: 1987717
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987717%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [ayvens.be] INFO: Scrape type for 1987717: 1
2026-03-27 22:48:53 [ayvens.be] INFO: Extracting data for car ID: 1987717
2026-03-27 22:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e534096c-270b-561c-8092-d4c9f1a9414e with identifier: 1987717
2026-03-27 22:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e534096c-270b-561c-8092-d4c9f1a9414e with scrape type 1
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/1.jpg not downloaded yet
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/2.jpg not downloaded yet
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45534d0>
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/7.jpg saved to cache
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/3.jpg not downloaded yet
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/4.jpg not downloaded yet
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/5.jpg not downloaded yet
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ffa50>
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/6.jpg saved to cache
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564950>
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/9.jpg saved to cache
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4525490>
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/8.jpg saved to cache
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/6.jpg not downloaded yet
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4565490>
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F668fe36cd67244b0ae568f2a6ecf7ef1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/10.jpg saved to cache
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afce20e0-0f9d-5532-9419-4f1d72af1645
2026-03-27 22:48:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afce20e0-0f9d-5532-9419-4f1d72af1645, skipping ID generation
2026-03-27 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afce20e0-0f9d-5532-9419-4f1d72af1645 with scrape type 1
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afce20e0-0f9d-5532-9419-4f1d72af1645 sending to next pipeline
2026-03-27 22:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: afce20e0-0f9d-5532-9419-4f1d72af1645, identifier: 1987715
2026-03-27 22:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: afce20e0-0f9d-5532-9419-4f1d72af1645 with identifier: 1987715
2026-03-27 22:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: afce20e0-0f9d-5532-9419-4f1d72af1645 with identifier: 1987715
2026-03-27 22:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: afce20e0-0f9d-5532-9419-4f1d72af1645 with identifier: 1987715 to the API
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'afce20e0-0f9d-5532-9419-4f1d72af1645',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 Active Tourer',
 'odometer': 126990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afce20e0-0f9d-5532-9419-4f1d72af1645/afce20e0-0f9d-5532-9419-4f1d72af1645_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/668fe36cd67244b0ae568f2a6ecf7ef1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2 Active Tourer 1.5 216D GRAN TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D GRAN TOURER',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987715%27 HTTP/1.1" 200 None
2026-03-27 22:48:54 [ayvens.be] INFO: Saving data for 1987715: {'created_time': 1774651734.781279, 'last_price_update_time': 1774651734.78129, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987715') HTTP/1.1" 204 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/7.jpg not downloaded yet
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4551d50>
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/1.jpg saved to cache
2026-03-27 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458cc10>
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/3.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540df50>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/2.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/8.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/9.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/10.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [ayvens.be] INFO: Found listing with ID: 1987718
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987718%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [ayvens.be] INFO: Scrape type for 1987718: 1
2026-03-27 22:48:55 [ayvens.be] INFO: Extracting data for car ID: 1987718
2026-03-27 22:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d101074a-2666-50cb-be40-2b1bdbc11311 with identifier: 1987718
2026-03-27 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d101074a-2666-50cb-be40-2b1bdbc11311 with scrape type 1
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/1.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/2.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/3.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540df10>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/4.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541cb90>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/1.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/4.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6410>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/5.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/5.jpg not downloaded yet
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/6.jpg not downloaded yet
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4583750>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/7.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4529650>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/9.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454a350>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/6.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eaa10>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/8.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53bb390>
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff039013d9f104011a55ca95d8212bdd6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/10.jpg saved to cache
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0965d552-f195-5b85-8fac-abf90f4aea94
2026-03-27 22:48:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0965d552-f195-5b85-8fac-abf90f4aea94, skipping ID generation
2026-03-27 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0965d552-f195-5b85-8fac-abf90f4aea94 with scrape type 1
2026-03-27 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0965d552-f195-5b85-8fac-abf90f4aea94 sending to next pipeline
2026-03-27 22:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0965d552-f195-5b85-8fac-abf90f4aea94, identifier: 1987716
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5386dd0>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/2.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540c550>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/3.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0965d552-f195-5b85-8fac-abf90f4aea94 with identifier: 1987716
2026-03-27 22:48:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0965d552-f195-5b85-8fac-abf90f4aea94 with identifier: 1987716
2026-03-27 22:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0965d552-f195-5b85-8fac-abf90f4aea94 with identifier: 1987716 to the API
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'MEDITERRANBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0965d552-f195-5b85-8fac-abf90f4aea94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 102866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965d552-f195-5b85-8fac-abf90f4aea94/0965d552-f195-5b85-8fac-abf90f4aea94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f039013d9f104011a55ca95d8212bdd6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987716%27 HTTP/1.1" 200 None
2026-03-27 22:48:56 [ayvens.be] INFO: Saving data for 1987716: {'created_time': 1774651736.519413, 'last_price_update_time': 1774651736.519423, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987716') HTTP/1.1" 204 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/7.jpg not downloaded yet
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b2550>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/5.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/8.jpg not downloaded yet
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7342c50>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/6.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ecd50>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/4.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547b190>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/10.jpg saved to cache
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/9.jpg not downloaded yet
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4565450>
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/8.jpg saved to cache
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a5350>
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/9.jpg saved to cache
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316990>
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1re%252F335681142706445d9843bf423aa46848%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/7.jpg saved to cache
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e534096c-270b-561c-8092-d4c9f1a9414e
2026-03-27 22:48:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e534096c-270b-561c-8092-d4c9f1a9414e, skipping ID generation
2026-03-27 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e534096c-270b-561c-8092-d4c9f1a9414e with scrape type 1
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e534096c-270b-561c-8092-d4c9f1a9414e sending to next pipeline
2026-03-27 22:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e534096c-270b-561c-8092-d4c9f1a9414e, identifier: 1987717
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/10.jpg not downloaded yet
2026-03-27 22:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e534096c-270b-561c-8092-d4c9f1a9414e with identifier: 1987717
2026-03-27 22:48:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e534096c-270b-561c-8092-d4c9f1a9414e with identifier: 1987717
2026-03-27 22:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e534096c-270b-561c-8092-d4c9f1a9414e with identifier: 1987717 to the API
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'WIT BANQUISE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e534096c-270b-561c-8092-d4c9f1a9414e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'Expert',
 'odometer': 74172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e534096c-270b-561c-8092-d4c9f1a9414e/e534096c-270b-561c-8092-d4c9f1a9414e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1re/335681142706445d9843bf423aa46848/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT Expert 1.6 BlueHDi L2 Standard Premium STOCK',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi L2 Standard Premium STOCK',
 'vin': None,
 'year': 2016}
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987717%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [ayvens.be] INFO: Saving data for 1987717: {'created_time': 1774651737.676138, 'last_price_update_time': 1774651737.676149, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987717') HTTP/1.1" 204 0
2026-03-27 22:48:57 [ayvens.be] INFO: Found listing with ID: 1987719
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987719%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [ayvens.be] INFO: Scrape type for 1987719: 1
2026-03-27 22:48:57 [ayvens.be] INFO: Extracting data for car ID: 1987719
2026-03-27 22:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e135b70-c0c7-54ac-86b5-1be346485787 with identifier: 1987719
2026-03-27 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e135b70-c0c7-54ac-86b5-1be346485787 with scrape type 1
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/1.jpg not downloaded yet
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/2.jpg not downloaded yet
2026-03-27 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/3.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/4.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/5.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/6.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/7.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/8.jpg not downloaded yet
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/9.jpg not downloaded yet
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5718e50>
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/2.jpg saved to cache
2026-03-27 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5427990>
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/6.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5424d10>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/1.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c14d0>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/4.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c15d0>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/5.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560ef10>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/3.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4595850>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/7.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/10.jpg not downloaded yet
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7131cd0>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/8.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [ayvens.be] INFO: Found listing with ID: 1987720
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987720%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [ayvens.be] INFO: Scrape type for 1987720: 1
2026-03-27 22:48:58 [ayvens.be] INFO: Extracting data for car ID: 1987720
2026-03-27 22:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ed6855-027a-5860-9195-42b0238c1f31 with identifier: 1987720
2026-03-27 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ed6855-027a-5860-9195-42b0238c1f31 with scrape type 1
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/1.jpg not downloaded yet
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/2.jpg not downloaded yet
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/3.jpg not downloaded yet
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/4.jpg not downloaded yet
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457ce50>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/10.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/5.jpg not downloaded yet
2026-03-27 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/6.jpg not downloaded yet
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7d413d0>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/2.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ea6d0>
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F6b86b7708aac4063bf09a71d6ddae41d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/9.jpg saved to cache
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d101074a-2666-50cb-be40-2b1bdbc11311
2026-03-27 22:48:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d101074a-2666-50cb-be40-2b1bdbc11311, skipping ID generation
2026-03-27 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d101074a-2666-50cb-be40-2b1bdbc11311 with scrape type 1
2026-03-27 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d101074a-2666-50cb-be40-2b1bdbc11311 sending to next pipeline
2026-03-27 22:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d101074a-2666-50cb-be40-2b1bdbc11311, identifier: 1987718
2026-03-27 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d101074a-2666-50cb-be40-2b1bdbc11311 with identifier: 1987718
2026-03-27 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d101074a-2666-50cb-be40-2b1bdbc11311 with identifier: 1987718
2026-03-27 22:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d101074a-2666-50cb-be40-2b1bdbc11311 with identifier: 1987718 to the API
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'MINERAL WEISS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd101074a-2666-50cb-be40-2b1bdbc11311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d101074a-2666-50cb-be40-2b1bdbc11311/d101074a-2666-50cb-be40-2b1bdbc11311_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/6b86b7708aac4063bf09a71d6ddae41d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987718%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [ayvens.be] INFO: Saving data for 1987718: {'created_time': 1774651739.308962, 'last_price_update_time': 1774651739.308972, 'auction_closing_time': 1775115000.0}
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987718') HTTP/1.1" 204 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/7.jpg not downloaded yet
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557bfd0>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/3.jpg saved to cache
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d14090>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/5.jpg saved to cache
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5655d50>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/1.jpg saved to cache
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d14c90>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/4.jpg saved to cache
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5564590>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/6.jpg saved to cache
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/8.jpg not downloaded yet
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/9.jpg not downloaded yet
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/10.jpg not downloaded yet
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [ayvens.be] INFO: Found listing with ID: 1987721
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987721%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [ayvens.be] INFO: Scrape type for 1987721: 1
2026-03-27 22:48:59 [ayvens.be] INFO: Extracting data for car ID: 1987721
2026-03-27 22:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b135fb15-eec2-5b20-9e41-856abd1bbc0c with identifier: 1987721
2026-03-27 22:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b135fb15-eec2-5b20-9e41-856abd1bbc0c with scrape type 1
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/1.jpg not downloaded yet
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/2.jpg not downloaded yet
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/3.jpg not downloaded yet
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/4.jpg not downloaded yet
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459e2d0>
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/1.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ff910>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/7.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/5.jpg not downloaded yet
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5630f90>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/9.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc3350>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/2.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/6.jpg not downloaded yet
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5396ad0>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/10.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541c6d0>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/3.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5384f50>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/4.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541ca50>
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F3e95c222d1784cbbb7df9560c0c9ec26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/8.jpg saved to cache
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e135b70-c0c7-54ac-86b5-1be346485787
2026-03-27 22:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e135b70-c0c7-54ac-86b5-1be346485787, skipping ID generation
2026-03-27 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e135b70-c0c7-54ac-86b5-1be346485787 with scrape type 1
2026-03-27 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e135b70-c0c7-54ac-86b5-1be346485787 sending to next pipeline
2026-03-27 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e135b70-c0c7-54ac-86b5-1be346485787, identifier: 1987719
2026-03-27 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e135b70-c0c7-54ac-86b5-1be346485787 with identifier: 1987719
2026-03-27 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e135b70-c0c7-54ac-86b5-1be346485787 with identifier: 1987719
2026-03-27 22:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e135b70-c0c7-54ac-86b5-1be346485787 with identifier: 1987719 to the API
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'DOLPHIN GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9e135b70-c0c7-54ac-86b5-1be346485787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 53883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e135b70-c0c7-54ac-86b5-1be346485787/9e135b70-c0c7-54ac-86b5-1be346485787_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/3e95c222d1784cbbb7df9560c0c9ec26/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987719%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [ayvens.be] INFO: Saving data for 1987719: {'created_time': 1774651741.329733, 'last_price_update_time': 1774651741.329742, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987719') HTTP/1.1" 204 0
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/7.jpg not downloaded yet
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/8.jpg not downloaded yet
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540d550>
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/5.jpg saved to cache
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/9.jpg not downloaded yet
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/10.jpg not downloaded yet
2026-03-27 22:49:01 [ayvens.be] INFO: Found listing with ID: 1987722
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987722%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [ayvens.be] INFO: Scrape type for 1987722: 1
2026-03-27 22:49:01 [ayvens.be] INFO: Extracting data for car ID: 1987722
2026-03-27 22:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ee49b3-9f15-58d6-b402-5781adf1d097 with identifier: 1987722
2026-03-27 22:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ee49b3-9f15-58d6-b402-5781adf1d097 with scrape type 1
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/1.jpg not downloaded yet
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/2.jpg not downloaded yet
2026-03-27 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4563810>
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/9.jpg saved to cache
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/3.jpg not downloaded yet
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/4.jpg not downloaded yet
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56512d0>
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/10.jpg saved to cache
2026-03-27 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549f410>
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/8.jpg saved to cache
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a5950>
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/6.jpg saved to cache
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549e2d0>
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fcab834e9b3b7405099fa76399a0efb50%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/7.jpg saved to cache
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7ed6855-027a-5860-9195-42b0238c1f31
2026-03-27 22:49:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7ed6855-027a-5860-9195-42b0238c1f31, skipping ID generation
2026-03-27 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ed6855-027a-5860-9195-42b0238c1f31 with scrape type 1
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7ed6855-027a-5860-9195-42b0238c1f31 sending to next pipeline
2026-03-27 22:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d7ed6855-027a-5860-9195-42b0238c1f31, identifier: 1987720
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0510>
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/4.jpg saved to cache
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541cd50>
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/3.jpg saved to cache
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d7ed6855-027a-5860-9195-42b0238c1f31 with identifier: 1987720
2026-03-27 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d7ed6855-027a-5860-9195-42b0238c1f31 with identifier: 1987720
2026-03-27 22:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d7ed6855-027a-5860-9195-42b0238c1f31 with identifier: 1987720 to the API
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'HIGHLAND GREY METALLIC',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd7ed6855-027a-5860-9195-42b0238c1f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 67072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed6855-027a-5860-9195-42b0238c1f31/d7ed6855-027a-5860-9195-42b0238c1f31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/cab834e9b3b7405099fa76399a0efb50/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 GRAND CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 GRAND CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987720%27 HTTP/1.1" 200 None
2026-03-27 22:49:02 [ayvens.be] INFO: Saving data for 1987720: {'created_time': 1774651742.930816, 'last_price_update_time': 1774651742.930826, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987720') HTTP/1.1" 204 0
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/5.jpg not downloaded yet
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/6.jpg not downloaded yet
2026-03-27 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/7.jpg not downloaded yet
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/8.jpg not downloaded yet
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/9.jpg not downloaded yet
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/10.jpg not downloaded yet
2026-03-27 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:03 [ayvens.be] INFO: Found listing with ID: 1987723
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987723%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [ayvens.be] INFO: Scrape type for 1987723: 1
2026-03-27 22:49:03 [ayvens.be] INFO: Extracting data for car ID: 1987723
2026-03-27 22:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf58c341-39d3-55f3-b774-24cf171ed112 with identifier: 1987723
2026-03-27 22:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf58c341-39d3-55f3-b774-24cf171ed112 with scrape type 1
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/1.jpg not downloaded yet
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/2.jpg not downloaded yet
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5387350>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/2.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c8750>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/1.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541dd10>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/6.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55cad90>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/5.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55cbc90>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/7.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5584ad0>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/8.jpg saved to cache
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/3.jpg not downloaded yet
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560fad0>
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/10.jpg saved to cache
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/4.jpg not downloaded yet
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/5.jpg not downloaded yet
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560d410>
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Fc05151f14b594d199531e9d090424eba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/9.jpg saved to cache
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b135fb15-eec2-5b20-9e41-856abd1bbc0c
2026-03-27 22:49:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b135fb15-eec2-5b20-9e41-856abd1bbc0c, skipping ID generation
2026-03-27 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b135fb15-eec2-5b20-9e41-856abd1bbc0c with scrape type 1
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b135fb15-eec2-5b20-9e41-856abd1bbc0c sending to next pipeline
2026-03-27 22:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b135fb15-eec2-5b20-9e41-856abd1bbc0c, identifier: 1987721
2026-03-27 22:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b135fb15-eec2-5b20-9e41-856abd1bbc0c with identifier: 1987721
2026-03-27 22:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b135fb15-eec2-5b20-9e41-856abd1bbc0c with identifier: 1987721
2026-03-27 22:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b135fb15-eec2-5b20-9e41-856abd1bbc0c with identifier: 1987721 to the API
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b135fb15-eec2-5b20-9e41-856abd1bbc0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA SPORTS TOURER',
 'odometer': 62487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b135fb15-eec2-5b20-9e41-856abd1bbc0c/b135fb15-eec2-5b20-9e41-856abd1bbc0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/c05151f14b594d199531e9d090424eba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA SPORTS TOURER 1.2 TURBO 81KW S-S EDITION',
 'transmission': 'manual',
 'trim': '1.2 TURBO 81KW S-S EDITION',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987721%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [ayvens.be] INFO: Saving data for 1987721: {'created_time': 1774651744.648753, 'last_price_update_time': 1774651744.648764, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987721') HTTP/1.1" 204 0
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/6.jpg not downloaded yet
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/7.jpg not downloaded yet
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/8.jpg not downloaded yet
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/9.jpg not downloaded yet
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/10.jpg not downloaded yet
2026-03-27 22:49:04 [ayvens.be] INFO: Found listing with ID: 1987724
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987724%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [ayvens.be] INFO: Scrape type for 1987724: 1
2026-03-27 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1987724
2026-03-27 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c22cc8af-4cd3-5700-bab6-787b32458a13 with identifier: 1987724
2026-03-27 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c22cc8af-4cd3-5700-bab6-787b32458a13 with scrape type 1
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/1.jpg not downloaded yet
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/2.jpg not downloaded yet
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653f90>
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/2.jpg saved to cache
2026-03-27 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5427450>
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/5.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753dd10>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/3.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4524d90>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/6.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fefd0>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/1.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/3.jpg not downloaded yet
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e88210>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/7.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5394bd0>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/4.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52be5d0>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/8.jpg saved to cache
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/4.jpg not downloaded yet
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/5.jpg not downloaded yet
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/6.jpg not downloaded yet
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/7.jpg not downloaded yet
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/8.jpg not downloaded yet
2026-03-27 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/9.jpg not downloaded yet
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/10.jpg not downloaded yet
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e12f10>
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/2.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [ayvens.be] INFO: Found listing with ID: 1987725
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987725%27 HTTP/1.1" 200 None
2026-03-27 22:49:06 [ayvens.be] INFO: Scrape type for 1987725: 1
2026-03-27 22:49:06 [ayvens.be] INFO: Extracting data for car ID: 1987725
2026-03-27 22:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7da2744-5476-5d5a-a4e1-5466363eb86a with identifier: 1987725
2026-03-27 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7da2744-5476-5d5a-a4e1-5466363eb86a with scrape type 1
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/1.jpg not downloaded yet
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ff950>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/4.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b1c50>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/10.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/2.jpg not downloaded yet
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/3.jpg not downloaded yet
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5461fd0>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F867351b3d04248d58a2831842c708436%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/9.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75ee49b3-9f15-58d6-b402-5781adf1d097
2026-03-27 22:49:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75ee49b3-9f15-58d6-b402-5781adf1d097, skipping ID generation
2026-03-27 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ee49b3-9f15-58d6-b402-5781adf1d097 with scrape type 1
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75ee49b3-9f15-58d6-b402-5781adf1d097 sending to next pipeline
2026-03-27 22:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75ee49b3-9f15-58d6-b402-5781adf1d097, identifier: 1987722
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ec510>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/3.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f7310>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/5.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a6450>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/1.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5579ad0>
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/6.jpg saved to cache
2026-03-27 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75ee49b3-9f15-58d6-b402-5781adf1d097 with identifier: 1987722
2026-03-27 22:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75ee49b3-9f15-58d6-b402-5781adf1d097 with identifier: 1987722
2026-03-27 22:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75ee49b3-9f15-58d6-b402-5781adf1d097 with identifier: 1987722 to the API
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '75ee49b3-9f15-58d6-b402-5781adf1d097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 62281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ee49b3-9f15-58d6-b402-5781adf1d097/75ee49b3-9f15-58d6-b402-5781adf1d097_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/867351b3d04248d58a2831842c708436/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '1.5 T2 Momentum Pro Geartronic',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987722%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [ayvens.be] INFO: Saving data for 1987722: {'created_time': 1774651747.26276, 'last_price_update_time': 1774651747.262771, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987722') HTTP/1.1" 204 0
2026-03-27 22:49:07 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at -2 pages/min), scraped 129 items (at 36 items/min)
2026-03-27 22:49:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/4.jpg not downloaded yet
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/5.jpg not downloaded yet
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4567190>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/7.jpg saved to cache
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/6.jpg not downloaded yet
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/7.jpg not downloaded yet
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540ee90>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/3.jpg saved to cache
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478550>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/2.jpg saved to cache
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc1750>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/10.jpg saved to cache
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/8.jpg not downloaded yet
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/9.jpg not downloaded yet
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534a650>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/1.jpg saved to cache
2026-03-27 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5461d10>
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/9.jpg saved to cache
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc3590>
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/4.jpg saved to cache
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/10.jpg not downloaded yet
2026-03-27 22:49:08 [ayvens.be] INFO: Found listing with ID: 1987726
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987726%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [ayvens.be] INFO: Scrape type for 1987726: 1
2026-03-27 22:49:08 [ayvens.be] INFO: Extracting data for car ID: 1987726
2026-03-27 22:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 884671a9-b81b-55c6-97fa-d6e767c45e14 with identifier: 1987726
2026-03-27 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 884671a9-b81b-55c6-97fa-d6e767c45e14 with scrape type 1
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/1.jpg not downloaded yet
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/2.jpg not downloaded yet
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/3.jpg not downloaded yet
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/4.jpg not downloaded yet
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/5.jpg not downloaded yet
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/6.jpg not downloaded yet
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/7.jpg not downloaded yet
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5462a10>
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/5.jpg saved to cache
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/8.jpg not downloaded yet
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548290>
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F505264d1de0a489585a2691c389d44bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/8.jpg saved to cache
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf58c341-39d3-55f3-b774-24cf171ed112
2026-03-27 22:49:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf58c341-39d3-55f3-b774-24cf171ed112, skipping ID generation
2026-03-27 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf58c341-39d3-55f3-b774-24cf171ed112 with scrape type 1
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf58c341-39d3-55f3-b774-24cf171ed112 sending to next pipeline
2026-03-27 22:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf58c341-39d3-55f3-b774-24cf171ed112, identifier: 1987723
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53148d0>
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/7.jpg saved to cache
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/9.jpg not downloaded yet
2026-03-27 22:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf58c341-39d3-55f3-b774-24cf171ed112 with identifier: 1987723
2026-03-27 22:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf58c341-39d3-55f3-b774-24cf171ed112 with identifier: 1987723
2026-03-27 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf58c341-39d3-55f3-b774-24cf171ed112 with identifier: 1987723 to the API
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf58c341-39d3-55f3-b774-24cf171ed112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 105656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf58c341-39d3-55f3-b774-24cf171ed112/bf58c341-39d3-55f3-b774-24cf171ed112_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/505264d1de0a489585a2691c389d44bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987723%27 HTTP/1.1" 200 None
2026-03-27 22:49:09 [ayvens.be] INFO: Saving data for 1987723: {'created_time': 1774651749.311215, 'last_price_update_time': 1774651749.311226, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987723') HTTP/1.1" 204 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/10.jpg not downloaded yet
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45485d0>
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/8.jpg saved to cache
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5317bd0>
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/6.jpg saved to cache
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ff7d0>
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/1.jpg saved to cache
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d796a250>
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/10.jpg saved to cache
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d733d890>
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb6d71d4798e144cda328357dc19a68c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/9.jpg saved to cache
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c22cc8af-4cd3-5700-bab6-787b32458a13
2026-03-27 22:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c22cc8af-4cd3-5700-bab6-787b32458a13, skipping ID generation
2026-03-27 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c22cc8af-4cd3-5700-bab6-787b32458a13 with scrape type 1
2026-03-27 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c22cc8af-4cd3-5700-bab6-787b32458a13 sending to next pipeline
2026-03-27 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c22cc8af-4cd3-5700-bab6-787b32458a13, identifier: 1987724
2026-03-27 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c22cc8af-4cd3-5700-bab6-787b32458a13 with identifier: 1987724
2026-03-27 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c22cc8af-4cd3-5700-bab6-787b32458a13 with identifier: 1987724
2026-03-27 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c22cc8af-4cd3-5700-bab6-787b32458a13 with identifier: 1987724 to the API
2026-03-27 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c22cc8af-4cd3-5700-bab6-787b32458a13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 54798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c22cc8af-4cd3-5700-bab6-787b32458a13/c22cc8af-4cd3-5700-bab6-787b32458a13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b6d71d4798e144cda328357dc19a68c8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987724%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [ayvens.be] INFO: Saving data for 1987724: {'created_time': 1774651750.255808, 'last_price_update_time': 1774651750.255817, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987724') HTTP/1.1" 204 0
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [ayvens.be] INFO: Found listing with ID: 1987727
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987727%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [ayvens.be] INFO: Scrape type for 1987727: 1
2026-03-27 22:49:10 [ayvens.be] INFO: Extracting data for car ID: 1987727
2026-03-27 22:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with identifier: 1987727
2026-03-27 22:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with scrape type 1
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/1.jpg not downloaded yet
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/2.jpg not downloaded yet
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/3.jpg not downloaded yet
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/4.jpg not downloaded yet
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/5.jpg not downloaded yet
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5426110>
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/2.jpg saved to cache
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/6.jpg not downloaded yet
2026-03-27 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5654d50>
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/3.jpg saved to cache
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668750>
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/4.jpg saved to cache
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/7.jpg not downloaded yet
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/8.jpg not downloaded yet
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bd5d0>
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/5.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c9110>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/6.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15cd0>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/7.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504d50>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/9.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541f550>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/8.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/9.jpg not downloaded yet
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/10.jpg not downloaded yet
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [ayvens.be] INFO: Found listing with ID: 1987728
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987728%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [ayvens.be] INFO: Scrape type for 1987728: 1
2026-03-27 22:49:11 [ayvens.be] INFO: Extracting data for car ID: 1987728
2026-03-27 22:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc480fa9-8bb6-5b16-8088-d5ea2949770d with identifier: 1987728
2026-03-27 22:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc480fa9-8bb6-5b16-8088-d5ea2949770d with scrape type 1
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/1.jpg not downloaded yet
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/2.jpg not downloaded yet
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/3.jpg not downloaded yet
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/4.jpg not downloaded yet
2026-03-27 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/5.jpg not downloaded yet
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e11790>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/1.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/6.jpg not downloaded yet
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56271d0>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/2.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53483d0>
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc58be7ab5c914616b3d199d6a4df4ba9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/10.jpg saved to cache
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7da2744-5476-5d5a-a4e1-5466363eb86a
2026-03-27 22:49:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7da2744-5476-5d5a-a4e1-5466363eb86a, skipping ID generation
2026-03-27 22:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7da2744-5476-5d5a-a4e1-5466363eb86a with scrape type 1
2026-03-27 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7da2744-5476-5d5a-a4e1-5466363eb86a sending to next pipeline
2026-03-27 22:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7da2744-5476-5d5a-a4e1-5466363eb86a, identifier: 1987725
2026-03-27 22:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7da2744-5476-5d5a-a4e1-5466363eb86a with identifier: 1987725
2026-03-27 22:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7da2744-5476-5d5a-a4e1-5466363eb86a with identifier: 1987725
2026-03-27 22:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7da2744-5476-5d5a-a4e1-5466363eb86a with identifier: 1987725 to the API
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b7da2744-5476-5d5a-a4e1-5466363eb86a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 98054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 943205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7da2744-5476-5d5a-a4e1-5466363eb86a/b7da2744-5476-5d5a-a4e1-5466363eb86a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c58be7ab5c914616b3d199d6a4df4ba9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987725%27 HTTP/1.1" 200 None
2026-03-27 22:49:12 [ayvens.be] INFO: Saving data for 1987725: {'created_time': 1774651752.295714, 'last_price_update_time': 1774651752.295723, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987725') HTTP/1.1" 204 0
2026-03-27 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/7.jpg not downloaded yet
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2ed0>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/3.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341410>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/4.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541fe50>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/9.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7348590>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/7.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5430c90>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/8.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/8.jpg not downloaded yet
2026-03-27 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d733ed50>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/2.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78ec250>
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/3.jpg saved to cache
2026-03-27 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/9.jpg not downloaded yet
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/10.jpg not downloaded yet
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53261d0>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/6.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [ayvens.be] INFO: Found listing with ID: 1987729
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987729%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [ayvens.be] INFO: Scrape type for 1987729: 1
2026-03-27 22:49:13 [ayvens.be] INFO: Extracting data for car ID: 1987729
2026-03-27 22:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with identifier: 1987729
2026-03-27 22:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with scrape type 1
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/1.jpg not downloaded yet
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5386450>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/1.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/2.jpg not downloaded yet
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45afa50>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/7.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5385010>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/5.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/3.jpg not downloaded yet
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/4.jpg not downloaded yet
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459aa90>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/8.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f4190>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/6.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56313d0>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/9.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547e0d0>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/10.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5718150>
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F10b73754f3d84774a99b80e9f2461ca8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/10.jpg saved to cache
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 884671a9-b81b-55c6-97fa-d6e767c45e14
2026-03-27 22:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 884671a9-b81b-55c6-97fa-d6e767c45e14, skipping ID generation
2026-03-27 22:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 884671a9-b81b-55c6-97fa-d6e767c45e14 with scrape type 1
2026-03-27 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 884671a9-b81b-55c6-97fa-d6e767c45e14 sending to next pipeline
2026-03-27 22:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 884671a9-b81b-55c6-97fa-d6e767c45e14, identifier: 1987726
2026-03-27 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457ecd0>
2026-03-27 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/5.jpg saved to cache
2026-03-27 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 884671a9-b81b-55c6-97fa-d6e767c45e14 with identifier: 1987726
2026-03-27 22:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 884671a9-b81b-55c6-97fa-d6e767c45e14 with identifier: 1987726
2026-03-27 22:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 884671a9-b81b-55c6-97fa-d6e767c45e14 with identifier: 1987726 to the API
2026-03-27 22:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '884671a9-b81b-55c6-97fa-d6e767c45e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 36593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 941418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884671a9-b81b-55c6-97fa-d6e767c45e14/884671a9-b81b-55c6-97fa-d6e767c45e14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/10b73754f3d84774a99b80e9f2461ca8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW ACENTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW ACENTA XTRONIC',
 'vin': None,
 'year': 2023}
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987726%27 HTTP/1.1" 200 None
2026-03-27 22:49:15 [ayvens.be] INFO: Saving data for 1987726: {'created_time': 1774651755.682407, 'last_price_update_time': 1774651755.682418, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987726') HTTP/1.1" 204 0
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/5.jpg not downloaded yet
2026-03-27 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/6.jpg not downloaded yet
2026-03-27 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b21d0>
2026-03-27 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F087d613c1b6642719388e11d69d4d7b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/4.jpg saved to cache
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5
2026-03-27 22:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b9aa897-64d3-50ac-8898-03b4a782eeb5, skipping ID generation
2026-03-27 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with scrape type 1
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b9aa897-64d3-50ac-8898-03b4a782eeb5 sending to next pipeline
2026-03-27 22:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b9aa897-64d3-50ac-8898-03b4a782eeb5, identifier: 1987727
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/7.jpg not downloaded yet
2026-03-27 22:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with identifier: 1987727
2026-03-27 22:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with identifier: 1987727
2026-03-27 22:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b9aa897-64d3-50ac-8898-03b4a782eeb5 with identifier: 1987727 to the API
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9b9aa897-64d3-50ac-8898-03b4a782eeb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 88352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b9aa897-64d3-50ac-8898-03b4a782eeb5/9b9aa897-64d3-50ac-8898-03b4a782eeb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/087d613c1b6642719388e11d69d4d7b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L1 LIGHT 96KW S-S AUTO PREMIUM',
 'transmission': 'automatic',
 'trim': '1.5 BHDI L1 LIGHT 96KW S-S AUTO PREMIUM',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987727%27 HTTP/1.1" 200 None
2026-03-27 22:49:16 [ayvens.be] INFO: Saving data for 1987727: {'created_time': 1774651756.300691, 'last_price_update_time': 1774651756.300701, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987727') HTTP/1.1" 204 0
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/8.jpg not downloaded yet
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5627c90>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/2.jpg saved to cache
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4507210>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/5.jpg saved to cache
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d0110>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/6.jpg saved to cache
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/9.jpg not downloaded yet
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/10.jpg not downloaded yet
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569b810>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/4.jpg saved to cache
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5424750>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/3.jpg saved to cache
2026-03-27 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44c3c10>
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/8.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530d0d0>
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/7.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5615ed0>
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/1.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [ayvens.be] INFO: Found listing with ID: 1987730
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987730%27 HTTP/1.1" 200 None
2026-03-27 22:49:17 [ayvens.be] INFO: Scrape type for 1987730: 1
2026-03-27 22:49:17 [ayvens.be] INFO: Extracting data for car ID: 1987730
2026-03-27 22:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f44710bf-a31d-5718-9465-3282fda11e73 with identifier: 1987730
2026-03-27 22:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f44710bf-a31d-5718-9465-3282fda11e73 with scrape type 1
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/1.jpg not downloaded yet
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/2.jpg not downloaded yet
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431110>
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/1.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f7e50>
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/9.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/3.jpg not downloaded yet
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e6dd0>
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fda292efeeed141cab81862edda9152f1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/10.jpg saved to cache
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc480fa9-8bb6-5b16-8088-d5ea2949770d
2026-03-27 22:49:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc480fa9-8bb6-5b16-8088-d5ea2949770d, skipping ID generation
2026-03-27 22:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc480fa9-8bb6-5b16-8088-d5ea2949770d with scrape type 1
2026-03-27 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc480fa9-8bb6-5b16-8088-d5ea2949770d sending to next pipeline
2026-03-27 22:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cc480fa9-8bb6-5b16-8088-d5ea2949770d, identifier: 1987728
2026-03-27 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cc480fa9-8bb6-5b16-8088-d5ea2949770d with identifier: 1987728
2026-03-27 22:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cc480fa9-8bb6-5b16-8088-d5ea2949770d with identifier: 1987728
2026-03-27 22:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cc480fa9-8bb6-5b16-8088-d5ea2949770d with identifier: 1987728 to the API
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cc480fa9-8bb6-5b16-8088-d5ea2949770d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 113503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc480fa9-8bb6-5b16-8088-d5ea2949770d/cc480fa9-8bb6-5b16-8088-d5ea2949770d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/da292efeeed141cab81862edda9152f1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987728%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [ayvens.be] INFO: Saving data for 1987728: {'created_time': 1774651758.093092, 'last_price_update_time': 1774651758.093102, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987728') HTTP/1.1" 204 0
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/4.jpg not downloaded yet
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4531050>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/4.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5614c50>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/2.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc2750>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/3.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3ed0>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/6.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/5.jpg not downloaded yet
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4594850>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/7.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/6.jpg not downloaded yet
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d73484d0>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/5.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459ec50>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/8.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/7.jpg not downloaded yet
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/8.jpg not downloaded yet
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/9.jpg not downloaded yet
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/10.jpg not downloaded yet
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [ayvens.be] INFO: Found listing with ID: 1987731
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987731%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [ayvens.be] INFO: Scrape type for 1987731: 1
2026-03-27 22:49:18 [ayvens.be] INFO: Extracting data for car ID: 1987731
2026-03-27 22:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2c6d76-dda5-5d26-a15c-4b49e6446537 with identifier: 1987731
2026-03-27 22:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2c6d76-dda5-5d26-a15c-4b49e6446537 with scrape type 1
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/1.jpg not downloaded yet
2026-03-27 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/2.jpg not downloaded yet
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45070d0>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/9.jpg saved to cache
2026-03-27 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5910>
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fb25e3705ac944e7da31007dfbc28abd1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/10.jpg saved to cache
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0
2026-03-27 22:49:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0, skipping ID generation
2026-03-27 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with scrape type 1
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 sending to next pipeline
2026-03-27 22:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0, identifier: 1987729
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/3.jpg not downloaded yet
2026-03-27 22:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with identifier: 1987729
2026-03-27 22:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with identifier: 1987729
2026-03-27 22:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8ac7e310-4150-5bc8-85cd-e99b18edb0a0 with identifier: 1987729 to the API
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8ac7e310-4150-5bc8-85cd-e99b18edb0a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 52510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac7e310-4150-5bc8-85cd-e99b18edb0a0/8ac7e310-4150-5bc8-85cd-e99b18edb0a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/b25e3705ac944e7da31007dfbc28abd1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987729%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [ayvens.be] INFO: Saving data for 1987729: {'created_time': 1774651759.506232, 'last_price_update_time': 1774651759.50625, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987729') HTTP/1.1" 204 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/4.jpg not downloaded yet
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/5.jpg not downloaded yet
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b7250>
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/1.jpg saved to cache
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4597bd0>
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/2.jpg saved to cache
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5373b90>
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/3.jpg saved to cache
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569cfd0>
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/4.jpg saved to cache
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/6.jpg not downloaded yet
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/7.jpg not downloaded yet
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566e490>
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/6.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/8.jpg not downloaded yet
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/9.jpg not downloaded yet
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d30d0>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/1.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4506550>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/7.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1290>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/5.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5656f50>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/8.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55852d0>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/10.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/10.jpg not downloaded yet
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5719c50>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F877b4986f71c48c09622bbe137fd5027%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/9.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f44710bf-a31d-5718-9465-3282fda11e73
2026-03-27 22:49:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f44710bf-a31d-5718-9465-3282fda11e73, skipping ID generation
2026-03-27 22:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f44710bf-a31d-5718-9465-3282fda11e73 with scrape type 1
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f44710bf-a31d-5718-9465-3282fda11e73 sending to next pipeline
2026-03-27 22:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f44710bf-a31d-5718-9465-3282fda11e73, identifier: 1987730
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f650>
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/2.jpg saved to cache
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:20 [ayvens.be] INFO: Found listing with ID: 1987732
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987732%27 HTTP/1.1" 200 None
2026-03-27 22:49:20 [ayvens.be] INFO: Scrape type for 1987732: 1
2026-03-27 22:49:20 [ayvens.be] INFO: Extracting data for car ID: 1987732
2026-03-27 22:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61036861-7113-535b-9165-1fd1aacbd269 with identifier: 1987732
2026-03-27 22:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61036861-7113-535b-9165-1fd1aacbd269 with scrape type 1
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/1.jpg not downloaded yet
2026-03-27 22:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f44710bf-a31d-5718-9465-3282fda11e73 with identifier: 1987730
2026-03-27 22:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f44710bf-a31d-5718-9465-3282fda11e73 with identifier: 1987730
2026-03-27 22:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f44710bf-a31d-5718-9465-3282fda11e73 with identifier: 1987730 to the API
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f44710bf-a31d-5718-9465-3282fda11e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 92291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44710bf-a31d-5718-9465-3282fda11e73/f44710bf-a31d-5718-9465-3282fda11e73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/877b4986f71c48c09622bbe137fd5027/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI Move! DSG (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.0 TSI Move! DSG (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987730%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [ayvens.be] INFO: Saving data for 1987730: {'created_time': 1774651761.004588, 'last_price_update_time': 1774651761.004597, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987730') HTTP/1.1" 204 0
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/2.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569f1d0>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/3.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/3.jpg not downloaded yet
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/4.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5317490>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/5.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/5.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7056c50>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/4.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1750>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/6.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/6.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53ced90>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/7.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7341450>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/8.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/7.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5687950>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/10.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/8.jpg not downloaded yet
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44f6310>
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ffa925e1ef8ae4921a310d214037533de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/9.jpg saved to cache
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf2c6d76-dda5-5d26-a15c-4b49e6446537
2026-03-27 22:49:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf2c6d76-dda5-5d26-a15c-4b49e6446537, skipping ID generation
2026-03-27 22:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2c6d76-dda5-5d26-a15c-4b49e6446537 with scrape type 1
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf2c6d76-dda5-5d26-a15c-4b49e6446537 sending to next pipeline
2026-03-27 22:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf2c6d76-dda5-5d26-a15c-4b49e6446537, identifier: 1987731
2026-03-27 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/9.jpg not downloaded yet
2026-03-27 22:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf2c6d76-dda5-5d26-a15c-4b49e6446537 with identifier: 1987731
2026-03-27 22:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf2c6d76-dda5-5d26-a15c-4b49e6446537 with identifier: 1987731
2026-03-27 22:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf2c6d76-dda5-5d26-a15c-4b49e6446537 with identifier: 1987731 to the API
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cf2c6d76-dda5-5d26-a15c-4b49e6446537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 - 2017',
 'odometer': 62631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2c6d76-dda5-5d26-a15c-4b49e6446537/cf2c6d76-dda5-5d26-a15c-4b49e6446537_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/fa925e1ef8ae4921a310d214037533de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 - 2017 50 TFSi e PHEV Q Sport S tronic',
 'transmission': 'automatic',
 'trim': '50 TFSi e PHEV Q Sport S tronic',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987731%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [ayvens.be] INFO: Saving data for 1987731: {'created_time': 1774651762.315325, 'last_price_update_time': 1774651762.315336, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987731') HTTP/1.1" 204 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/10.jpg not downloaded yet
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5655a50>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/1.jpg saved to cache
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:22 [ayvens.be] INFO: Found listing with ID: 1987733
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987733%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [ayvens.be] INFO: Scrape type for 1987733: 1
2026-03-27 22:49:22 [ayvens.be] INFO: Extracting data for car ID: 1987733
2026-03-27 22:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bceae5c0-2151-5b02-9ae1-ae74e820512c with identifier: 1987733
2026-03-27 22:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceae5c0-2151-5b02-9ae1-ae74e820512c with scrape type 1
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/1.jpg not downloaded yet
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/2.jpg not downloaded yet
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5656c10>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/3.jpg saved to cache
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/3.jpg not downloaded yet
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/4.jpg not downloaded yet
2026-03-27 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/5.jpg not downloaded yet
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530e410>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/2.jpg saved to cache
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56af610>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/4.jpg saved to cache
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5550690>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/5.jpg saved to cache
2026-03-27 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c72d0>
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/6.jpg saved to cache
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b2590>
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/7.jpg saved to cache
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/6.jpg not downloaded yet
2026-03-27 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/7.jpg not downloaded yet
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569fe90>
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/8.jpg saved to cache
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45840d0>
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/9.jpg saved to cache
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/8.jpg not downloaded yet
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/9.jpg not downloaded yet
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7055950>
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F42342cd844ea4951a3170db9d1020758%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/10.jpg saved to cache
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61036861-7113-535b-9165-1fd1aacbd269
2026-03-27 22:49:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61036861-7113-535b-9165-1fd1aacbd269, skipping ID generation
2026-03-27 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61036861-7113-535b-9165-1fd1aacbd269 with scrape type 1
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61036861-7113-535b-9165-1fd1aacbd269 sending to next pipeline
2026-03-27 22:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61036861-7113-535b-9165-1fd1aacbd269, identifier: 1987732
2026-03-27 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61036861-7113-535b-9165-1fd1aacbd269 with identifier: 1987732
2026-03-27 22:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61036861-7113-535b-9165-1fd1aacbd269 with identifier: 1987732
2026-03-27 22:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61036861-7113-535b-9165-1fd1aacbd269 with identifier: 1987732 to the API
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '61036861-7113-535b-9165-1fd1aacbd269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 96871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61036861-7113-535b-9165-1fd1aacbd269/61036861-7113-535b-9165-1fd1aacbd269_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/42342cd844ea4951a3170db9d1020758/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987732%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [ayvens.be] INFO: Saving data for 1987732: {'created_time': 1774651763.891904, 'last_price_update_time': 1774651763.891914, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987732') HTTP/1.1" 204 0
2026-03-27 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/10.jpg not downloaded yet
2026-03-27 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:23 [ayvens.be] INFO: Found listing with ID: 1987734
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987734%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [ayvens.be] INFO: Scrape type for 1987734: 1
2026-03-27 22:49:23 [ayvens.be] INFO: Extracting data for car ID: 1987734
2026-03-27 22:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with identifier: 1987734
2026-03-27 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with scrape type 1
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/1.jpg not downloaded yet
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7056bd0>
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/1.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/2.jpg not downloaded yet
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/3.jpg not downloaded yet
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ff810>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/3.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b2050>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/2.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7340f50>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/5.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/4.jpg not downloaded yet
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/5.jpg not downloaded yet
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d75f4a90>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/4.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/6.jpg not downloaded yet
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/7.jpg not downloaded yet
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459d350>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/7.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0390>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/6.jpg saved to cache
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/8.jpg not downloaded yet
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/9.jpg not downloaded yet
2026-03-27 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4598110>
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/8.jpg saved to cache
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4520b50>
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/9.jpg saved to cache
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c9110>
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F378065e527a54021b93706d8edb6549e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/10.jpg saved to cache
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bceae5c0-2151-5b02-9ae1-ae74e820512c
2026-03-27 22:49:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bceae5c0-2151-5b02-9ae1-ae74e820512c, skipping ID generation
2026-03-27 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceae5c0-2151-5b02-9ae1-ae74e820512c with scrape type 1
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bceae5c0-2151-5b02-9ae1-ae74e820512c sending to next pipeline
2026-03-27 22:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bceae5c0-2151-5b02-9ae1-ae74e820512c, identifier: 1987733
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/10.jpg not downloaded yet
2026-03-27 22:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bceae5c0-2151-5b02-9ae1-ae74e820512c with identifier: 1987733
2026-03-27 22:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bceae5c0-2151-5b02-9ae1-ae74e820512c with identifier: 1987733
2026-03-27 22:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bceae5c0-2151-5b02-9ae1-ae74e820512c with identifier: 1987733 to the API
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bceae5c0-2151-5b02-9ae1-ae74e820512c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO LIFE SWB',
 'odometer': 102330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceae5c0-2151-5b02-9ae1-ae74e820512c/bceae5c0-2151-5b02-9ae1-ae74e820512c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/378065e527a54021b93706d8edb6549e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'OPEL COMBO LIFE SWB 1.2 T L1H1 Edition S-S (EU6.3)',
 'transmission': 'manual',
 'trim': '1.2 T L1H1 Edition S-S (EU6.3)',
 'vin': None,
 'year': 2020}
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987733%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [ayvens.be] INFO: Saving data for 1987733: {'created_time': 1774651765.731181, 'last_price_update_time': 1774651765.731192, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987733') HTTP/1.1" 204 0
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [ayvens.be] INFO: Found listing with ID: 1987735
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987735%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [ayvens.be] INFO: Scrape type for 1987735: 1
2026-03-27 22:49:25 [ayvens.be] INFO: Extracting data for car ID: 1987735
2026-03-27 22:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8156cf70-425d-5c90-adb4-482ef09cb4c1 with identifier: 1987735
2026-03-27 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8156cf70-425d-5c90-adb4-482ef09cb4c1 with scrape type 1
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/1.jpg not downloaded yet
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56de450>
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/1.jpg saved to cache
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/2.jpg not downloaded yet
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/3.jpg not downloaded yet
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668510>
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/2.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549d90>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/5.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/4.jpg not downloaded yet
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/5.jpg not downloaded yet
2026-03-27 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54300d0>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/3.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4599590>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/4.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5348210>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/6.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7814150>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/7.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fedd0>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/8.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/6.jpg not downloaded yet
2026-03-27 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/7.jpg not downloaded yet
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d6b10>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/10.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/8.jpg not downloaded yet
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/9.jpg not downloaded yet
2026-03-27 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/10.jpg not downloaded yet
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569ea10>
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6b66fb5ce5e144f4be24842075cbd251%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/9.jpg saved to cache
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4
2026-03-27 22:49:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4, skipping ID generation
2026-03-27 22:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with scrape type 1
2026-03-27 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 sending to next pipeline
2026-03-27 22:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4, identifier: 1987734
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [ayvens.be] INFO: Found listing with ID: 1987736
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987736%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [ayvens.be] INFO: Scrape type for 1987736: 1
2026-03-27 22:49:27 [ayvens.be] INFO: Extracting data for car ID: 1987736
2026-03-27 22:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc2898d-0648-5070-b941-76c74b6e30da with identifier: 1987736
2026-03-27 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc2898d-0648-5070-b941-76c74b6e30da with scrape type 1
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/1.jpg not downloaded yet
2026-03-27 22:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with identifier: 1987734
2026-03-27 22:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with identifier: 1987734
2026-03-27 22:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4944cf20-ca54-5f2a-bb47-3c537e3e02c4 with identifier: 1987734 to the API
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4944cf20-ca54-5f2a-bb47-3c537e3e02c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 81526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4944cf20-ca54-5f2a-bb47-3c537e3e02c4/4944cf20-ca54-5f2a-bb47-3c537e3e02c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6b66fb5ce5e144f4be24842075cbd251/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 1.2 PURETECH E6.3 55KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH E6.3 55KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987734%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [ayvens.be] INFO: Saving data for 1987734: {'created_time': 1774651767.462586, 'last_price_update_time': 1774651767.462599, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987734') HTTP/1.1" 204 0
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/2.jpg not downloaded yet
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c8fd0>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/1.jpg saved to cache
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753eb50>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/3.jpg saved to cache
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/3.jpg not downloaded yet
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/4.jpg not downloaded yet
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ca150>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/2.jpg saved to cache
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cef50>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/5.jpg saved to cache
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/5.jpg not downloaded yet
2026-03-27 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/6.jpg not downloaded yet
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b2ed0>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/6.jpg saved to cache
2026-03-27 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5658990>
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/8.jpg saved to cache
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5555f50>
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/7.jpg saved to cache
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53869d0>
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/10.jpg saved to cache
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/7.jpg not downloaded yet
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556ad0>
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/9.jpg saved to cache
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b3450>
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F25fad774419d488c871001c21c03686a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/4.jpg saved to cache
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8156cf70-425d-5c90-adb4-482ef09cb4c1
2026-03-27 22:49:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8156cf70-425d-5c90-adb4-482ef09cb4c1, skipping ID generation
2026-03-27 22:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8156cf70-425d-5c90-adb4-482ef09cb4c1 with scrape type 1
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8156cf70-425d-5c90-adb4-482ef09cb4c1 sending to next pipeline
2026-03-27 22:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8156cf70-425d-5c90-adb4-482ef09cb4c1, identifier: 1987735
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/8.jpg not downloaded yet
2026-03-27 22:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8156cf70-425d-5c90-adb4-482ef09cb4c1 with identifier: 1987735
2026-03-27 22:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8156cf70-425d-5c90-adb4-482ef09cb4c1 with identifier: 1987735
2026-03-27 22:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8156cf70-425d-5c90-adb4-482ef09cb4c1 with identifier: 1987735 to the API
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8156cf70-425d-5c90-adb4-482ef09cb4c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 67633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8156cf70-425d-5c90-adb4-482ef09cb4c1/8156cf70-425d-5c90-adb4-482ef09cb4c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/25fad774419d488c871001c21c03686a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 1.2 PURETECH 55KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 55KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987735%27 HTTP/1.1" 200 None
2026-03-27 22:49:28 [ayvens.be] INFO: Saving data for 1987735: {'created_time': 1774651768.922046, 'last_price_update_time': 1774651768.922055, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987735') HTTP/1.1" 204 0
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/9.jpg not downloaded yet
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/10.jpg not downloaded yet
2026-03-27 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:28 [ayvens.be] INFO: Found listing with ID: 1987737
2026-03-27 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987737%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [ayvens.be] INFO: Scrape type for 1987737: 1
2026-03-27 22:49:29 [ayvens.be] INFO: Extracting data for car ID: 1987737
2026-03-27 22:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with identifier: 1987737
2026-03-27 22:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with scrape type 1
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/1.jpg not downloaded yet
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/2.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/3.jpg not downloaded yet
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/4.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/5.jpg not downloaded yet
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/6.jpg not downloaded yet
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52e9590>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/1.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d3790>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/2.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/7.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/8.jpg not downloaded yet
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fd550>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/4.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d722ffd0>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/3.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56173d0>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/5.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/9.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/10.jpg not downloaded yet
2026-03-27 22:49:29 [ayvens.be] INFO: Found listing with ID: 1987738
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987738%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [ayvens.be] INFO: Scrape type for 1987738: 1
2026-03-27 22:49:29 [ayvens.be] INFO: Extracting data for car ID: 1987738
2026-03-27 22:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b505de-e73c-56e3-8970-569aa52e20fe with identifier: 1987738
2026-03-27 22:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b505de-e73c-56e3-8970-569aa52e20fe with scrape type 1
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/1.jpg not downloaded yet
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1890>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/6.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/2.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/3.jpg not downloaded yet
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53873d0>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/7.jpg saved to cache
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/4.jpg not downloaded yet
2026-03-27 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/5.jpg not downloaded yet
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/6.jpg not downloaded yet
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4507650>
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/10.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f6350>
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/2.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5395fd0>
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/1.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566fa10>
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/8.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4548bd0>
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/3.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/7.jpg not downloaded yet
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/8.jpg not downloaded yet
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5396590>
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7053303c2d4d44c1b480e1cac94035b0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/9.jpg saved to cache
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abc2898d-0648-5070-b941-76c74b6e30da
2026-03-27 22:49:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abc2898d-0648-5070-b941-76c74b6e30da, skipping ID generation
2026-03-27 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc2898d-0648-5070-b941-76c74b6e30da with scrape type 1
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abc2898d-0648-5070-b941-76c74b6e30da sending to next pipeline
2026-03-27 22:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abc2898d-0648-5070-b941-76c74b6e30da, identifier: 1987736
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/9.jpg not downloaded yet
2026-03-27 22:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abc2898d-0648-5070-b941-76c74b6e30da with identifier: 1987736
2026-03-27 22:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abc2898d-0648-5070-b941-76c74b6e30da with identifier: 1987736
2026-03-27 22:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abc2898d-0648-5070-b941-76c74b6e30da with identifier: 1987736 to the API
2026-03-27 22:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'abc2898d-0648-5070-b941-76c74b6e30da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 58787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc2898d-0648-5070-b941-76c74b6e30da/abc2898d-0648-5070-b941-76c74b6e30da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7053303c2d4d44c1b480e1cac94035b0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987736%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [ayvens.be] INFO: Saving data for 1987736: {'created_time': 1774651771.472915, 'last_price_update_time': 1774651771.472924, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987736') HTTP/1.1" 204 0
2026-03-27 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/10.jpg not downloaded yet
2026-03-27 22:49:31 [ayvens.be] INFO: Found listing with ID: 1987739
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987739%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [ayvens.be] INFO: Scrape type for 1987739: 1
2026-03-27 22:49:31 [ayvens.be] INFO: Extracting data for car ID: 1987739
2026-03-27 22:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86a3504-50fa-5705-a330-fb01e1cd0ea6 with identifier: 1987739
2026-03-27 22:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 with scrape type 1
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/1.jpg not downloaded yet
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/2.jpg not downloaded yet
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/3.jpg not downloaded yet
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/4.jpg not downloaded yet
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 55b505de-e73c-56e3-8970-569aa52e20fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/5.jpg not downloaded yet
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/6.jpg not downloaded yet
2026-03-27 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549ffd0>
2026-03-27 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F7bfd462997db4348995ab14028a268ee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/10.jpg saved to cache
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5
2026-03-27 22:49:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5, skipping ID generation
2026-03-27 22:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with scrape type 1
2026-03-27 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 sending to next pipeline
2026-03-27 22:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5, identifier: 1987737
2026-03-27 22:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with identifier: 1987737
2026-03-27 22:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with identifier: 1987737
2026-03-27 22:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63802dbb-1744-5d30-8b4d-8f67da2bb4c5 with identifier: 1987737 to the API
2026-03-27 22:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '63802dbb-1744-5d30-8b4d-8f67da2bb4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5-serie',
 'odometer': 93771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63802dbb-1744-5d30-8b4d-8f67da2bb4c5/63802dbb-1744-5d30-8b4d-8f67da2bb4c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/7bfd462997db4348995ab14028a268ee/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5-serie 2.0 530E 200KW XDRIVE AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 530E 200KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987737%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [ayvens.be] INFO: Saving data for 1987737: {'created_time': 1774651772.159375, 'last_price_update_time': 1774651772.159385, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987737') HTTP/1.1" 204 0
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/7.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/8.jpg not downloaded yet
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/9.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/10.jpg not downloaded yet
2026-03-27 22:49:32 [ayvens.be] INFO: Found listing with ID: 1987740
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987740%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [ayvens.be] INFO: Scrape type for 1987740: 1
2026-03-27 22:49:32 [ayvens.be] INFO: Extracting data for car ID: 1987740
2026-03-27 22:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61376484-f10f-5734-b90f-aef2709ee9f8 with identifier: 1987740
2026-03-27 22:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61376484-f10f-5734-b90f-aef2709ee9f8 with scrape type 1
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/1.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/2.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/3.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/4.jpg not downloaded yet
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549de50>
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/7.jpg saved to cache
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/5.jpg not downloaded yet
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/6.jpg not downloaded yet
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/7.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/8.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/9.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/10.jpg not downloaded yet
2026-03-27 22:49:32 [ayvens.be] INFO: Found listing with ID: 1987741
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987741%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [ayvens.be] INFO: Scrape type for 1987741: 1
2026-03-27 22:49:32 [ayvens.be] INFO: Extracting data for car ID: 1987741
2026-03-27 22:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430139c6-3a6b-5ca4-a3ac-a3a098783c08 with identifier: 1987741
2026-03-27 22:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08 with scrape type 1
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/1.jpg not downloaded yet
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4890>
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/10.jpg saved to cache
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/2.jpg not downloaded yet
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5463490>
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/4.jpg saved to cache
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 55b505de-e73c-56e3-8970-569aa52e20fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 55b505de-e73c-56e3-8970-569aa52e20fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 55b505de-e73c-56e3-8970-569aa52e20fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/3.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/4.jpg not downloaded yet
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/5.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/6.jpg not downloaded yet
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/7.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/8.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/9.jpg not downloaded yet
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/10.jpg not downloaded yet
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d0110>
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/5.jpg saved to cache
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:33 [ayvens.be] INFO: Found listing with ID: 1987742
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987742%27 HTTP/1.1" 200 None
2026-03-27 22:49:33 [ayvens.be] INFO: Scrape type for 1987742: 1
2026-03-27 22:49:33 [ayvens.be] INFO: Extracting data for car ID: 1987742
2026-03-27 22:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90895580-b15c-5e37-8546-a2f0a138043b with identifier: 1987742
2026-03-27 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90895580-b15c-5e37-8546-a2f0a138043b with scrape type 1
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/1.jpg not downloaded yet
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/2.jpg not downloaded yet
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/3.jpg not downloaded yet
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5694290>
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/6.jpg saved to cache
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b8dd0>
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/1.jpg saved to cache
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4549150>
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F41a38841af2a420095d7c1a82e0318e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/2.jpg saved to cache
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55b505de-e73c-56e3-8970-569aa52e20fe
2026-03-27 22:49:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55b505de-e73c-56e3-8970-569aa52e20fe, skipping ID generation
2026-03-27 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b505de-e73c-56e3-8970-569aa52e20fe with scrape type 1
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55b505de-e73c-56e3-8970-569aa52e20fe sending to next pipeline
2026-03-27 22:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55b505de-e73c-56e3-8970-569aa52e20fe, identifier: 1987738
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d78b7f90>
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/2.jpg saved to cache
2026-03-27 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55b505de-e73c-56e3-8970-569aa52e20fe with identifier: 1987738
2026-03-27 22:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55b505de-e73c-56e3-8970-569aa52e20fe with identifier: 1987738
2026-03-27 22:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55b505de-e73c-56e3-8970-569aa52e20fe with identifier: 1987738 to the API
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '55b505de-e73c-56e3-8970-569aa52e20fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 61847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b505de-e73c-56e3-8970-569aa52e20fe/55b505de-e73c-56e3-8970-569aa52e20fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/41a38841af2a420095d7c1a82e0318e8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987738%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [ayvens.be] INFO: Saving data for 1987738: {'created_time': 1774651774.085842, 'last_price_update_time': 1774651774.085853, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987738') HTTP/1.1" 204 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/4.jpg not downloaded yet
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/5.jpg not downloaded yet
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3f10>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/6.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/6.jpg not downloaded yet
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/7.jpg not downloaded yet
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3d10>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/8.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/8.jpg not downloaded yet
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b0090>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/6.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/9.jpg not downloaded yet
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505d50>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/7.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5385d50>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/4.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/10.jpg not downloaded yet
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [ayvens.be] INFO: Found listing with ID: 1987743
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987743%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [ayvens.be] INFO: Scrape type for 1987743: 1
2026-03-27 22:49:34 [ayvens.be] INFO: Extracting data for car ID: 1987743
2026-03-27 22:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2652aa0b-e39e-5a36-bb55-a18c7466091a with identifier: 1987743
2026-03-27 22:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652aa0b-e39e-5a36-bb55-a18c7466091a with scrape type 1
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/1.jpg not downloaded yet
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e8a690>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/3.jpg saved to cache
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/2.jpg not downloaded yet
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/3.jpg not downloaded yet
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc2a10>
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/5.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571a750>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/9.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4fd0>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/6.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/4.jpg not downloaded yet
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/5.jpg not downloaded yet
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/6.jpg not downloaded yet
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571a750>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/2.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/7.jpg not downloaded yet
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/8.jpg not downloaded yet
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/9.jpg not downloaded yet
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7341d50>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/2.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ffad0>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/3.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/10.jpg not downloaded yet
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 61376484-f10f-5734-b90f-aef2709ee9f8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 61376484-f10f-5734-b90f-aef2709ee9f8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:35 [ayvens.be] INFO: Found listing with ID: 1987744
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987744%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [ayvens.be] INFO: Scrape type for 1987744: 1
2026-03-27 22:49:35 [ayvens.be] INFO: Extracting data for car ID: 1987744
2026-03-27 22:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1041884b-3ada-52c8-8b9f-d238dc85c8c0 with identifier: 1987744
2026-03-27 22:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 with scrape type 1
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/1.jpg not downloaded yet
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/2.jpg not downloaded yet
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52eae10>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/10.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566be50>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/1.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557410>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/4.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/3.jpg not downloaded yet
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/4.jpg not downloaded yet
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2cd50>
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/9.jpg saved to cache
2026-03-27 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/5.jpg not downloaded yet
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/6.jpg not downloaded yet
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/7.jpg not downloaded yet
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/8.jpg not downloaded yet
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/9.jpg not downloaded yet
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4ed0>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/5.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dff50>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/1.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/10.jpg not downloaded yet
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [ayvens.be] INFO: Found listing with ID: 1987745
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987745%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [ayvens.be] INFO: Scrape type for 1987745: 1
2026-03-27 22:49:36 [ayvens.be] INFO: Extracting data for car ID: 1987745
2026-03-27 22:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4163bc04-a99d-5d7f-973a-b4bba3428099 with identifier: 1987745
2026-03-27 22:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4163bc04-a99d-5d7f-973a-b4bba3428099 with scrape type 1
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/1.jpg not downloaded yet
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/2.jpg not downloaded yet
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478f90>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/5.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e889d0>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/10.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f210>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fca73ca8c831e451a95e40033ad1e8471%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/6.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90895580-b15c-5e37-8546-a2f0a138043b
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/3.jpg not downloaded yet
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/4.jpg not downloaded yet
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7340410>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/6.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c8590>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/7.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5692f10>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/4.jpg saved to cache
2026-03-27 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540f050>
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/2.jpg saved to cache
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56901d0>
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/3.jpg saved to cache
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/5.jpg not downloaded yet
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 90895580-b15c-5e37-8546-a2f0a138043b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 90895580-b15c-5e37-8546-a2f0a138043b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 90895580-b15c-5e37-8546-a2f0a138043b with identifier: 1987742
2026-03-27 22:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 90895580-b15c-5e37-8546-a2f0a138043b with identifier: 1987742
2026-03-27 22:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 90895580-b15c-5e37-8546-a2f0a138043b with identifier: 1987742 to the API
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:37 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '90895580-b15c-5e37-8546-a2f0a138043b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 116144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90895580-b15c-5e37-8546-a2f0a138043b/90895580-b15c-5e37-8546-a2f0a138043b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ca73ca8c831e451a95e40033ad1e8471/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T3 MOMENTUM PRO AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T3 MOMENTUM PRO AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987742%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [ayvens.be] INFO: Saving data for 1987742: {'created_time': 1774651777.685848, 'last_price_update_time': 1774651777.685857, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987742') HTTP/1.1" 204 0
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/6.jpg not downloaded yet
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 90895580-b15c-5e37-8546-a2f0a138043b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/7.jpg not downloaded yet
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/8.jpg not downloaded yet
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653b90>
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fba9405fd20bb403f9e1991329808f606%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/8.jpg saved to cache
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/9.jpg not downloaded yet
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/10.jpg not downloaded yet
2026-03-27 22:49:37 [ayvens.be] INFO: Found listing with ID: 1987746
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987746%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [ayvens.be] INFO: Scrape type for 1987746: 1
2026-03-27 22:49:37 [ayvens.be] INFO: Extracting data for car ID: 1987746
2026-03-27 22:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e3d776-cac0-5623-a6b8-936a2a82d794 with identifier: 1987746
2026-03-27 22:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e3d776-cac0-5623-a6b8-936a2a82d794 with scrape type 1
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/1.jpg not downloaded yet
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7190>
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/9.jpg saved to cache
2026-03-27 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7944390>
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/8.jpg saved to cache
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/2.jpg not downloaded yet
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/3.jpg not downloaded yet
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/4.jpg not downloaded yet
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566ea90>
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/3.jpg saved to cache
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5343810>
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/2.jpg saved to cache
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d167d0>
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/10.jpg saved to cache
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/5.jpg not downloaded yet
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/6.jpg not downloaded yet
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/7.jpg not downloaded yet
2026-03-27 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/8.jpg not downloaded yet
2026-03-27 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/9.jpg not downloaded yet
2026-03-27 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/10.jpg not downloaded yet
2026-03-27 22:49:38 [ayvens.be] INFO: Found listing with ID: 1987747
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987747%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [ayvens.be] INFO: Scrape type for 1987747: 1
2026-03-27 22:49:38 [ayvens.be] INFO: Extracting data for car ID: 1987747
2026-03-27 22:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc779181-835a-587b-936d-14c268d38b04 with identifier: 1987747
2026-03-27 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc779181-835a-587b-936d-14c268d38b04 with scrape type 1
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/1.jpg not downloaded yet
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5396150>
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252Ffe961aca787a43b5aa9c044e11739763%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/10.jpg saved to cache
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2652aa0b-e39e-5a36-bb55-a18c7466091a
2026-03-27 22:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2652aa0b-e39e-5a36-bb55-a18c7466091a, skipping ID generation
2026-03-27 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652aa0b-e39e-5a36-bb55-a18c7466091a with scrape type 1
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2652aa0b-e39e-5a36-bb55-a18c7466091a sending to next pipeline
2026-03-27 22:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2652aa0b-e39e-5a36-bb55-a18c7466091a, identifier: 1987743
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/2.jpg not downloaded yet
2026-03-27 22:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2652aa0b-e39e-5a36-bb55-a18c7466091a with identifier: 1987743
2026-03-27 22:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2652aa0b-e39e-5a36-bb55-a18c7466091a with identifier: 1987743
2026-03-27 22:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2652aa0b-e39e-5a36-bb55-a18c7466091a with identifier: 1987743 to the API
2026-03-27 22:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2652aa0b-e39e-5a36-bb55-a18c7466091a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 65049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652aa0b-e39e-5a36-bb55-a18c7466091a/2652aa0b-e39e-5a36-bb55-a18c7466091a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/fe961aca787a43b5aa9c044e11739763/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987743%27 HTTP/1.1" 200 None
2026-03-27 22:49:39 [ayvens.be] INFO: Saving data for 1987743: {'created_time': 1774651779.178591, 'last_price_update_time': 1774651779.178601, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987743') HTTP/1.1" 204 0
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/3.jpg not downloaded yet
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5349c50>
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/9.jpg saved to cache
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d57246d0>
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/4.jpg saved to cache
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3290>
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0b091f161fa14ef6a7429f6340e887aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/6.jpg saved to cache
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e75d0>
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/1.jpg saved to cache
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/4.jpg not downloaded yet
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4163bc04-a99d-5d7f-973a-b4bba3428099 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1041884b-3ada-52c8-8b9f-d238dc85c8c0 with identifier: 1987744
2026-03-27 22:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1041884b-3ada-52c8-8b9f-d238dc85c8c0 with identifier: 1987744
2026-03-27 22:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1041884b-3ada-52c8-8b9f-d238dc85c8c0 with identifier: 1987744 to the API
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:39 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1041884b-3ada-52c8-8b9f-d238dc85c8c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 118622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1041884b-3ada-52c8-8b9f-d238dc85c8c0/1041884b-3ada-52c8-8b9f-d238dc85c8c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0b091f161fa14ef6a7429f6340e887aa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987744%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [ayvens.be] INFO: Saving data for 1987744: {'created_time': 1774651780.016856, 'last_price_update_time': 1774651780.016868, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987744') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 1041884b-3ada-52c8-8b9f-d238dc85c8c0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/5.jpg not downloaded yet
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/6.jpg not downloaded yet
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/7.jpg not downloaded yet
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/8.jpg not downloaded yet
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/9.jpg not downloaded yet
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/10.jpg not downloaded yet
2026-03-27 22:49:40 [ayvens.be] INFO: Found listing with ID: 1987748
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987748%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [ayvens.be] INFO: Scrape type for 1987748: 1
2026-03-27 22:49:40 [ayvens.be] INFO: Extracting data for car ID: 1987748
2026-03-27 22:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37162df4-63ad-5f2c-8b07-b3b0a1dede16 with identifier: 1987748
2026-03-27 22:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16 with scrape type 1
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/1.jpg not downloaded yet
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/2.jpg not downloaded yet
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56911d0>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/5.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4525290>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/3.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541b910>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/6.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458e950>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/7.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/3.jpg not downloaded yet
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fc490>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/8.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/4.jpg not downloaded yet
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/5.jpg not downloaded yet
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/6.jpg not downloaded yet
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1510>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/6.jpg saved to cache
2026-03-27 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed310>
2026-03-27 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/7.jpg saved to cache
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/7.jpg not downloaded yet
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/8.jpg not downloaded yet
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/9.jpg not downloaded yet
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554a490>
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/9.jpg saved to cache
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5419b10>
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/4.jpg saved to cache
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5553d90>
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/5.jpg saved to cache
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/10.jpg not downloaded yet
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 4163bc04-a99d-5d7f-973a-b4bba3428099 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 430139c6-3a6b-5ca4-a3ac-a3a098783c08 with identifier: 1987741
2026-03-27 22:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 430139c6-3a6b-5ca4-a3ac-a3a098783c08 with identifier: 1987741
2026-03-27 22:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 430139c6-3a6b-5ca4-a3ac-a3a098783c08 with identifier: 1987741 to the API
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:41 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '430139c6-3a6b-5ca4-a3ac-a3a098783c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 61963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430139c6-3a6b-5ca4-a3ac-a3a098783c08/430139c6-3a6b-5ca4-a3ac-a3a098783c08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/ba9405fd20bb403f9e1991329808f606/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS 1.5 DCI BLUE 95 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 DCI BLUE 95 CONFORT',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987741%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [ayvens.be] INFO: Saving data for 1987741: {'created_time': 1774651781.755881, 'last_price_update_time': 1774651781.755891, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987741') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 430139c6-3a6b-5ca4-a3ac-a3a098783c08 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:41 [ayvens.be] INFO: Found listing with ID: 1987749
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987749%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [ayvens.be] INFO: Scrape type for 1987749: 1
2026-03-27 22:49:41 [ayvens.be] INFO: Extracting data for car ID: 1987749
2026-03-27 22:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with identifier: 1987749
2026-03-27 22:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with scrape type 1
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/1.jpg not downloaded yet
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4f90>
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/10.jpg saved to cache
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/2.jpg not downloaded yet
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/3.jpg not downloaded yet
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/4.jpg not downloaded yet
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/5.jpg not downloaded yet
2026-03-27 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/6.jpg not downloaded yet
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/7.jpg not downloaded yet
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/8.jpg not downloaded yet
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/9.jpg not downloaded yet
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45522d0>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/5.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459f9d0>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/2.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45306d0>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/1.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5627350>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/6.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/10.jpg not downloaded yet
2026-03-27 22:49:42 [ayvens.be] INFO: Found listing with ID: 1987750
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987750%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [ayvens.be] INFO: Scrape type for 1987750: 1
2026-03-27 22:49:42 [ayvens.be] INFO: Extracting data for car ID: 1987750
2026-03-27 22:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with identifier: 1987750
2026-03-27 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with scrape type 1
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/1.jpg not downloaded yet
2026-03-27 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/2.jpg not downloaded yet
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4504d50>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/2.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/3.jpg not downloaded yet
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item cc779181-835a-587b-936d-14c268d38b04 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item cc779181-835a-587b-936d-14c268d38b04 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item e5e3d776-cac0-5623-a6b8-936a2a82d794 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/4.jpg not downloaded yet
2026-03-27 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5693f10>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/4.jpg saved to cache
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/5.jpg not downloaded yet
2026-03-27 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/6.jpg not downloaded yet
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547cd50>
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/7.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668150>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/1.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/7.jpg not downloaded yet
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/8.jpg not downloaded yet
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541d750>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/3.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2d850>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/10.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/9.jpg not downloaded yet
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/10.jpg not downloaded yet
2026-03-27 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:43 [ayvens.be] INFO: Found listing with ID: 1987751
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987751%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [ayvens.be] INFO: Scrape type for 1987751: 1
2026-03-27 22:49:43 [ayvens.be] INFO: Extracting data for car ID: 1987751
2026-03-27 22:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54c0126-4693-5cd0-893b-447ac1ddb476 with identifier: 1987751
2026-03-27 22:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54c0126-4693-5cd0-893b-447ac1ddb476 with scrape type 1
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/1.jpg not downloaded yet
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/2.jpg not downloaded yet
2026-03-27 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/3.jpg not downloaded yet
2026-03-27 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/4.jpg not downloaded yet
2026-03-27 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459ef90>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/1.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/5.jpg not downloaded yet
2026-03-27 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/6.jpg not downloaded yet
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/7.jpg not downloaded yet
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56eaa90>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/10.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540e250>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/2.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/8.jpg not downloaded yet
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4506dd0>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/4.jpg saved to cache
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/9.jpg not downloaded yet
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c5190>
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fce0a519862b240ce9d198775e765e3b7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/9.jpg saved to cache
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37162df4-63ad-5f2c-8b07-b3b0a1dede16 with identifier: 1987748
2026-03-27 22:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37162df4-63ad-5f2c-8b07-b3b0a1dede16 with identifier: 1987748
2026-03-27 22:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37162df4-63ad-5f2c-8b07-b3b0a1dede16 with identifier: 1987748 to the API
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:44 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '37162df4-63ad-5f2c-8b07-b3b0a1dede16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE E-TECH',
 'odometer': 58400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37162df4-63ad-5f2c-8b07-b3b0a1dede16/37162df4-63ad-5f2c-8b07-b3b0a1dede16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/ce0a519862b240ce9d198775e765e3b7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE E-TECH 60KWH R220 OPTIMUM CHARGE ICONIC',
 'transmission': 'automatic',
 'trim': '60KWH R220 OPTIMUM CHARGE ICONIC',
 'vin': None,
 'year': 2023}
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987748%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [ayvens.be] INFO: Saving data for 1987748: {'created_time': 1774651784.527029, 'last_price_update_time': 1774651784.527039, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987748') HTTP/1.1" 204 0
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/10.jpg not downloaded yet
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 37162df4-63ad-5f2c-8b07-b3b0a1dede16 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [ayvens.be] INFO: Found listing with ID: 1987752
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987752%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [ayvens.be] INFO: Scrape type for 1987752: 1
2026-03-27 22:49:44 [ayvens.be] INFO: Extracting data for car ID: 1987752
2026-03-27 22:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with identifier: 1987752
2026-03-27 22:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with scrape type 1
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/1.jpg not downloaded yet
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/2.jpg not downloaded yet
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/3.jpg not downloaded yet
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/4.jpg not downloaded yet
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/5.jpg not downloaded yet
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/6.jpg not downloaded yet
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d2c90>
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/8.jpg saved to cache
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/7.jpg not downloaded yet
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/8.jpg not downloaded yet
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/9.jpg not downloaded yet
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5693710>
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/1.jpg saved to cache
2026-03-27 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530c910>
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/3.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568f7d0>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/7.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557bc90>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/9.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/10.jpg not downloaded yet
2026-03-27 22:49:45 [ayvens.be] INFO: Found listing with ID: 1987753
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987753%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [ayvens.be] INFO: Scrape type for 1987753: 1
2026-03-27 22:49:45 [ayvens.be] INFO: Extracting data for car ID: 1987753
2026-03-27 22:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a719c464-e1af-56af-ab53-6cb8ee37bd6c with identifier: 1987753
2026-03-27 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a719c464-e1af-56af-ab53-6cb8ee37bd6c with scrape type 1
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/1.jpg not downloaded yet
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ae5d0>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/2.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541d950>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/3.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5669450>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/4.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5579310>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/1.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/2.jpg not downloaded yet
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/3.jpg not downloaded yet
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/4.jpg not downloaded yet
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/5.jpg not downloaded yet
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/6.jpg not downloaded yet
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/7.jpg not downloaded yet
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5484550>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/7.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/8.jpg not downloaded yet
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/9.jpg not downloaded yet
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/10.jpg not downloaded yet
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e72d0>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/10.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53fc910>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/6.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2c1d0>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/5.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5348d10>
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/10.jpg saved to cache
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:45 [ayvens.be] INFO: Found listing with ID: 1987754
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987754%27 HTTP/1.1" 200 None
2026-03-27 22:49:45 [ayvens.be] INFO: Scrape type for 1987754: 1
2026-03-27 22:49:45 [ayvens.be] INFO: Extracting data for car ID: 1987754
2026-03-27 22:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18ba4f4-33ea-5a6d-80db-e9c1060013ea with identifier: 1987754
2026-03-27 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea with scrape type 1
2026-03-27 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/1.jpg not downloaded yet
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/2.jpg not downloaded yet
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d534bf10>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbef78a448a8a4d368d87a246d42485dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/8.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a54c0126-4693-5cd0-893b-447ac1ddb476
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b3a90>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/6.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/3.jpg not downloaded yet
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/4.jpg not downloaded yet
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/5.jpg not downloaded yet
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e9050>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/8.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e7150>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/7.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f6b10>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/5.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/6.jpg not downloaded yet
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/7.jpg not downloaded yet
2026-03-27 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c6950>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/9.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5630a50>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/4.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d786b590>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/1.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653550>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/3.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e13d90>
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/3.jpg saved to cache
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/8.jpg not downloaded yet
2026-03-27 22:49:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a54c0126-4693-5cd0-893b-447ac1ddb476 with identifier: 1987751
2026-03-27 22:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a54c0126-4693-5cd0-893b-447ac1ddb476 with identifier: 1987751
2026-03-27 22:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a54c0126-4693-5cd0-893b-447ac1ddb476 with identifier: 1987751 to the API
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:47 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a54c0126-4693-5cd0-893b-447ac1ddb476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 108606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54c0126-4693-5cd0-893b-447ac1ddb476/a54c0126-4693-5cd0-893b-447ac1ddb476_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/bef78a448a8a4d368d87a246d42485dd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 258KW EXT. RANGE PREMIUM AWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 258KW EXT. RANGE PREMIUM AWD',
 'vin': None,
 'year': 2024}
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987751%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [ayvens.be] INFO: Saving data for 1987751: {'created_time': 1774651787.405621, 'last_price_update_time': 1774651787.405633, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987751') HTTP/1.1" 204 0
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/9.jpg not downloaded yet
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a54c0126-4693-5cd0-893b-447ac1ddb476 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d786b590>
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/2.jpg saved to cache
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/10.jpg not downloaded yet
2026-03-27 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:47 [ayvens.be] INFO: Found listing with ID: 1987755
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987755%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [ayvens.be] INFO: Scrape type for 1987755: 1
2026-03-27 22:49:47 [ayvens.be] INFO: Extracting data for car ID: 1987755
2026-03-27 22:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a71f290-0f8a-50dc-95a0-29633e1a139f with identifier: 1987755
2026-03-27 22:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a71f290-0f8a-50dc-95a0-29633e1a139f with scrape type 1
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/1.jpg not downloaded yet
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/2.jpg not downloaded yet
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/3.jpg not downloaded yet
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/4.jpg not downloaded yet
2026-03-27 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/5.jpg not downloaded yet
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54302d0>
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/7.jpg saved to cache
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/6.jpg not downloaded yet
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/7.jpg not downloaded yet
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54ab5d0>
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/9.jpg saved to cache
2026-03-27 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457c650>
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F99ecb2b43cb048d985f6580d252c74cd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/10.jpg saved to cache
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84
2026-03-27 22:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84, skipping ID generation
2026-03-27 22:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with scrape type 1
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 sending to next pipeline
2026-03-27 22:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84, identifier: 1987752
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ac690>
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/4.jpg saved to cache
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d457fe50>
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/2.jpg saved to cache
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with identifier: 1987752
2026-03-27 22:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with identifier: 1987752
2026-03-27 22:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 87c7afb8-7ac9-5a1b-8c03-7b187745bb84 with identifier: 1987752 to the API
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '87c7afb8-7ac9-5a1b-8c03-7b187745bb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 91554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c7afb8-7ac9-5a1b-8c03-7b187745bb84/87c7afb8-7ac9-5a1b-8c03-7b187745bb84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/99ecb2b43cb048d985f6580d252c74cd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI 81KW CLEVER',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW CLEVER',
 'vin': None,
 'year': 2021}
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987752%27 HTTP/1.1" 200 None
2026-03-27 22:49:48 [ayvens.be] INFO: Saving data for 1987752: {'created_time': 1774651788.82455, 'last_price_update_time': 1774651788.824563, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987752') HTTP/1.1" 204 0
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/8.jpg not downloaded yet
2026-03-27 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/9.jpg not downloaded yet
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/10.jpg not downloaded yet
2026-03-27 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:48 [ayvens.be] INFO: Found listing with ID: 1987756
2026-03-27 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987756%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [ayvens.be] INFO: Scrape type for 1987756: 1
2026-03-27 22:49:49 [ayvens.be] INFO: Extracting data for car ID: 1987756
2026-03-27 22:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc36a77-9a3a-55f3-b466-9148d95345cc with identifier: 1987756
2026-03-27 22:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc36a77-9a3a-55f3-b466-9148d95345cc with scrape type 1
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/1.jpg not downloaded yet
2026-03-27 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/2.jpg not downloaded yet
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5655350>
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F73c1da4fd0e646ef98c136f6acee7fed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/5.jpg saved to cache
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a719c464-e1af-56af-ab53-6cb8ee37bd6c
2026-03-27 22:49:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a719c464-e1af-56af-ab53-6cb8ee37bd6c, skipping ID generation
2026-03-27 22:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a719c464-e1af-56af-ab53-6cb8ee37bd6c with scrape type 1
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a719c464-e1af-56af-ab53-6cb8ee37bd6c sending to next pipeline
2026-03-27 22:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a719c464-e1af-56af-ab53-6cb8ee37bd6c, identifier: 1987753
2026-03-27 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a719c464-e1af-56af-ab53-6cb8ee37bd6c with identifier: 1987753
2026-03-27 22:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a719c464-e1af-56af-ab53-6cb8ee37bd6c with identifier: 1987753
2026-03-27 22:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a719c464-e1af-56af-ab53-6cb8ee37bd6c with identifier: 1987753 to the API
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a719c464-e1af-56af-ab53-6cb8ee37bd6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 70258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a719c464-e1af-56af-ab53-6cb8ee37bd6c/a719c464-e1af-56af-ab53-6cb8ee37bd6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/73c1da4fd0e646ef98c136f6acee7fed/images/large/9.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW S TRONIC ATTRACTION B.E',
 'transmission': 'automatic',
 'trim': '1.0 TFSI 30 81KW S TRONIC ATTRACTION B.E',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987753%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [ayvens.be] INFO: Saving data for 1987753: {'created_time': 1774651789.577818, 'last_price_update_time': 1774651789.577828, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987753') HTTP/1.1" 204 0
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/3.jpg not downloaded yet
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/4.jpg not downloaded yet
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc0090>
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/6.jpg saved to cache
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cda90>
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/3.jpg saved to cache
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52dc610>
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/4.jpg saved to cache
2026-03-27 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5566950>
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/1.jpg saved to cache
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/5.jpg not downloaded yet
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/6.jpg not downloaded yet
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/7.jpg not downloaded yet
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/8.jpg not downloaded yet
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/9.jpg not downloaded yet
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/10.jpg not downloaded yet
2026-03-27 22:49:50 [ayvens.be] INFO: Found listing with ID: 1987757
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987757%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [ayvens.be] INFO: Scrape type for 1987757: 1
2026-03-27 22:49:50 [ayvens.be] INFO: Extracting data for car ID: 1987757
2026-03-27 22:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7c1dd1c-e46b-5076-8e63-a25766b6986d with identifier: 1987757
2026-03-27 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7c1dd1c-e46b-5076-8e63-a25766b6986d with scrape type 1
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/1.jpg not downloaded yet
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/2.jpg not downloaded yet
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/3.jpg not downloaded yet
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c9610>
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/7.jpg saved to cache
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54abe50>
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/3.jpg saved to cache
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b6510>
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F220e2571ed2847b7b877a361fe9eb56f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/6.jpg saved to cache
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28
2026-03-27 22:49:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28, skipping ID generation
2026-03-27 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with scrape type 1
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 sending to next pipeline
2026-03-27 22:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28, identifier: 1987750
2026-03-27 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with identifier: 1987750
2026-03-27 22:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with identifier: 1987750
2026-03-27 22:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28 with identifier: 1987750 to the API
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 51456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28/2f26b8fd-6ab7-5c79-b698-89ee2eb1cc28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/220e2571ed2847b7b877a361fe9eb56f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV RWD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV RWD AUTO',
 'vin': None,
 'year': 2024}
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987750%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [ayvens.be] INFO: Saving data for 1987750: {'created_time': 1774651790.918807, 'last_price_update_time': 1774651790.918817, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987750') HTTP/1.1" 204 0
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/4.jpg not downloaded yet
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7057350>
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F3141abe06da54625a32d76ddf796d7ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/7.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea
2026-03-27 22:49:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a18ba4f4-33ea-5a6d-80db-e9c1060013ea, skipping ID generation
2026-03-27 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea with scrape type 1
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a18ba4f4-33ea-5a6d-80db-e9c1060013ea sending to next pipeline
2026-03-27 22:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a18ba4f4-33ea-5a6d-80db-e9c1060013ea, identifier: 1987754
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a3290>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/10.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a18ba4f4-33ea-5a6d-80db-e9c1060013ea with identifier: 1987754
2026-03-27 22:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a18ba4f4-33ea-5a6d-80db-e9c1060013ea with identifier: 1987754
2026-03-27 22:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a18ba4f4-33ea-5a6d-80db-e9c1060013ea with identifier: 1987754 to the API
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a18ba4f4-33ea-5a6d-80db-e9c1060013ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 88997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ba4f4-33ea-5a6d-80db-e9c1060013ea/a18ba4f4-33ea-5a6d-80db-e9c1060013ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/3141abe06da54625a32d76ddf796d7ca/images/large/7.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW ST-LINE V',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW ST-LINE V',
 'vin': None,
 'year': 2022}
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987754%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [ayvens.be] INFO: Saving data for 1987754: {'created_time': 1774651791.566637, 'last_price_update_time': 1774651791.566647, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987754') HTTP/1.1" 204 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/5.jpg not downloaded yet
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454a010>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/10.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/6.jpg not downloaded yet
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5657250>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/8.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/7.jpg not downloaded yet
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/8.jpg not downloaded yet
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/9.jpg not downloaded yet
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/10.jpg not downloaded yet
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5624ad0>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/9.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:51 [ayvens.be] INFO: Found listing with ID: 1987758
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987758%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [ayvens.be] INFO: Scrape type for 1987758: 1
2026-03-27 22:49:51 [ayvens.be] INFO: Extracting data for car ID: 1987758
2026-03-27 22:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a350168f-2c10-596c-8a85-8872b12afee0 with identifier: 1987758
2026-03-27 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a350168f-2c10-596c-8a85-8872b12afee0 with scrape type 1
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/1.jpg not downloaded yet
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/2.jpg not downloaded yet
2026-03-27 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/3.jpg not downloaded yet
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458ddd0>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/1.jpg saved to cache
2026-03-27 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d5e90>
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/2.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5486710>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/5.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/4.jpg not downloaded yet
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/5.jpg not downloaded yet
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5630150>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/4.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5598590>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/2.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/6.jpg not downloaded yet
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/7.jpg not downloaded yet
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/8.jpg not downloaded yet
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/9.jpg not downloaded yet
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/10.jpg not downloaded yet
2026-03-27 22:49:52 [ayvens.be] INFO: Found listing with ID: 1987759
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987759%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [ayvens.be] INFO: Scrape type for 1987759: 1
2026-03-27 22:49:52 [ayvens.be] INFO: Extracting data for car ID: 1987759
2026-03-27 22:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b92d579-5f63-5587-a938-eb507f8b4413 with identifier: 1987759
2026-03-27 22:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b92d579-5f63-5587-a938-eb507f8b4413 with scrape type 1
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/1.jpg not downloaded yet
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/2.jpg not downloaded yet
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540e710>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/7.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5696410>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/8.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55674d0>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/2.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d569d110>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/3.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/3.jpg not downloaded yet
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/4.jpg not downloaded yet
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/5.jpg not downloaded yet
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56850d0>
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/4.jpg saved to cache
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/6.jpg not downloaded yet
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item dcc36a77-9a3a-55f3-b466-9148d95345cc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item dcc36a77-9a3a-55f3-b466-9148d95345cc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/7.jpg not downloaded yet
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/8.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/9.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/10.jpg not downloaded yet
2026-03-27 22:49:53 [ayvens.be] INFO: Found listing with ID: 1987760
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987760%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [ayvens.be] INFO: Scrape type for 1987760: 1
2026-03-27 22:49:53 [ayvens.be] INFO: Extracting data for car ID: 1987760
2026-03-27 22:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8727a73-a269-5df0-8c14-7e6e0eddef3f with identifier: 1987760
2026-03-27 22:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8727a73-a269-5df0-8c14-7e6e0eddef3f with scrape type 1
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/1.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/2.jpg not downloaded yet
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4529bd0>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/5.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1c50>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/7.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d14050>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/10.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fe5d0>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/1.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d15150>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/6.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/3.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/4.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/5.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/6.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/7.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/8.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/9.jpg not downloaded yet
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/10.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [ayvens.be] INFO: Found listing with ID: 1987761
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987761%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [ayvens.be] INFO: Scrape type for 1987761: 1
2026-03-27 22:49:53 [ayvens.be] INFO: Extracting data for car ID: 1987761
2026-03-27 22:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecf00300-7dd9-5e76-9b10-124f460f4e48 with identifier: 1987761
2026-03-27 22:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecf00300-7dd9-5e76-9b10-124f460f4e48 with scrape type 1
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/1.jpg not downloaded yet
2026-03-27 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45956d0>
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/7.jpg saved to cache
2026-03-27 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5397b10>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/6.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/2.jpg not downloaded yet
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5430ad0>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/5.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/3.jpg not downloaded yet
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a350168f-2c10-596c-8a85-8872b12afee0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d559bd10>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/8.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568f690>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/10.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56f6190>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/2.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566c350>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/1.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/4.jpg not downloaded yet
2026-03-27 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/5.jpg not downloaded yet
2026-03-27 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/6.jpg not downloaded yet
2026-03-27 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/7.jpg not downloaded yet
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/8.jpg not downloaded yet
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/9.jpg not downloaded yet
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/10.jpg not downloaded yet
2026-03-27 22:49:54 [ayvens.be] INFO: Found listing with ID: 1987762
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987762%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [ayvens.be] INFO: Scrape type for 1987762: 1
2026-03-27 22:49:54 [ayvens.be] INFO: Extracting data for car ID: 1987762
2026-03-27 22:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with identifier: 1987762
2026-03-27 22:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with scrape type 1
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/1.jpg not downloaded yet
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568d650>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/5.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1590>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/6.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d3190>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/4.jpg saved to cache
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/2.jpg not downloaded yet
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54791d0>
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/7.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d1090>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ef16bf397f54a40be2930e15df1a535%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/9.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a350168f-2c10-596c-8a85-8872b12afee0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/3.jpg not downloaded yet
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/4.jpg not downloaded yet
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/5.jpg not downloaded yet
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/6.jpg not downloaded yet
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/7.jpg not downloaded yet
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/8.jpg not downloaded yet
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/9.jpg not downloaded yet
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/10.jpg not downloaded yet
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a77d0>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/10.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c9210>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/9.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cbfd0>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/5.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4530490>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/6.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [ayvens.be] INFO: Found listing with ID: 1987763
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987763%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [ayvens.be] INFO: Scrape type for 1987763: 1
2026-03-27 22:49:55 [ayvens.be] INFO: Extracting data for car ID: 1987763
2026-03-27 22:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 656c2f2a-d040-5dac-bc40-ac87a9381884 with identifier: 1987763
2026-03-27 22:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656c2f2a-d040-5dac-bc40-ac87a9381884 with scrape type 1
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/1.jpg not downloaded yet
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4523110>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/7.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 5b92d579-5f63-5587-a938-eb507f8b4413 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/2.jpg not downloaded yet
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b06d0>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/1.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549f610>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/4.jpg saved to cache
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/3.jpg not downloaded yet
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/4.jpg not downloaded yet
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/5.jpg not downloaded yet
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b58d0>
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/8.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5443a50>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F12663f6665b84ada9bfcb15a3a705a6d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/2.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cf490>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/3.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/6.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/7.jpg not downloaded yet
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b1f90>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/2.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ff790>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/10.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5cc3490>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/5.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/8.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/9.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/10.jpg not downloaded yet
2026-03-27 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:56 [ayvens.be] INFO: Found listing with ID: 1987764
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987764%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [ayvens.be] INFO: Scrape type for 1987764: 1
2026-03-27 22:49:56 [ayvens.be] INFO: Extracting data for car ID: 1987764
2026-03-27 22:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc7d221-6f82-5388-b754-2709f55fe80c with identifier: 1987764
2026-03-27 22:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7d221-6f82-5388-b754-2709f55fe80c with scrape type 1
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/1.jpg not downloaded yet
2026-03-27 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/2.jpg not downloaded yet
2026-03-27 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/3.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/4.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/5.jpg not downloaded yet
2026-03-27 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44fd350>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/1.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568eed0>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/4.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/6.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/7.jpg not downloaded yet
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/8.jpg not downloaded yet
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7cd0>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/7.jpg saved to cache
2026-03-27 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5631010>
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/10.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2cc10>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/9.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/9.jpg not downloaded yet
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/10.jpg not downloaded yet
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [ayvens.be] INFO: Found listing with ID: 1987765
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987765%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [ayvens.be] INFO: Scrape type for 1987765: 1
2026-03-27 22:49:57 [ayvens.be] INFO: Extracting data for car ID: 1987765
2026-03-27 22:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a with identifier: 1987765
2026-03-27 22:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a with scrape type 1
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/1.jpg not downloaded yet
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/2.jpg not downloaded yet
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item ecf00300-7dd9-5e76-9b10-124f460f4e48 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5696a10>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/9.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/3.jpg not downloaded yet
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/4.jpg not downloaded yet
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54253d0>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/5.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d554a590>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/1.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/5.jpg not downloaded yet
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7010>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/6.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dcd50>
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5327723677c94dbfb3e7ba9dd6234802%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/8.jpg saved to cache
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70
2026-03-27 22:49:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84216e85-9d0d-5b49-b97a-6ff6fec92a70, skipping ID generation
2026-03-27 22:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with scrape type 1
2026-03-27 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84216e85-9d0d-5b49-b97a-6ff6fec92a70 sending to next pipeline
2026-03-27 22:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84216e85-9d0d-5b49-b97a-6ff6fec92a70, identifier: 1987762
2026-03-27 22:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with identifier: 1987762
2026-03-27 22:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with identifier: 1987762
2026-03-27 22:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84216e85-9d0d-5b49-b97a-6ff6fec92a70 with identifier: 1987762 to the API
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '84216e85-9d0d-5b49-b97a-6ff6fec92a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 48108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84216e85-9d0d-5b49-b97a-6ff6fec92a70/84216e85-9d0d-5b49-b97a-6ff6fec92a70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5327723677c94dbfb3e7ba9dd6234802/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV CORE DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV CORE DCT',
 'vin': None,
 'year': 2023}
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987762%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [ayvens.be] INFO: Saving data for 1987762: {'created_time': 1774651798.595321, 'last_price_update_time': 1774651798.59533, 'auction_closing_time': 1775115000.0}
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987762') HTTP/1.1" 204 0
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/6.jpg not downloaded yet
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cf410>
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fc3abcc83f69f460fa2bceca41ab04d64%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/8.jpg saved to cache
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecf00300-7dd9-5e76-9b10-124f460f4e48
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45226d0>
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/8.jpg saved to cache
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/7.jpg not downloaded yet
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 656c2f2a-d040-5dac-bc40-ac87a9381884 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 656c2f2a-d040-5dac-bc40-ac87a9381884 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 656c2f2a-d040-5dac-bc40-ac87a9381884 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/8.jpg not downloaded yet
2026-03-27 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/9.jpg not downloaded yet
2026-03-27 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/10.jpg not downloaded yet
2026-03-27 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:58 [ayvens.be] INFO: Found listing with ID: 1987766
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987766%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [ayvens.be] INFO: Scrape type for 1987766: 1
2026-03-27 22:49:59 [ayvens.be] INFO: Extracting data for car ID: 1987766
2026-03-27 22:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bdbd79-5fbe-5826-8e9f-888196c49dee with identifier: 1987766
2026-03-27 22:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bdbd79-5fbe-5826-8e9f-888196c49dee with scrape type 1
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/1.jpg not downloaded yet
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/2.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cf390>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/10.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/3.jpg not downloaded yet
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/4.jpg not downloaded yet
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/5.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e66d0>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/4.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2f350>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/2.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458fdd0>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/7.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/6.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b6c10>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/8.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/7.jpg not downloaded yet
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/8.jpg not downloaded yet
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/9.jpg not downloaded yet
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/10.jpg not downloaded yet
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [ayvens.be] INFO: Found listing with ID: 1987767
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987767%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [ayvens.be] INFO: Scrape type for 1987767: 1
2026-03-27 22:49:59 [ayvens.be] INFO: Extracting data for car ID: 1987767
2026-03-27 22:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with identifier: 1987767
2026-03-27 22:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with scrape type 1
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/1.jpg not downloaded yet
2026-03-27 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/2.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b4850>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/3.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/3.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568ebd0>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/3.jpg saved to cache
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/4.jpg not downloaded yet
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/5.jpg not downloaded yet
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5441e10>
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/1.jpg saved to cache
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ee910>
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/4.jpg saved to cache
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568cc10>
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F126dc45722604503ab61cf3bbd4e3b46%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/10.jpg saved to cache
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bc7d221-6f82-5388-b754-2709f55fe80c
2026-03-27 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/6.jpg not downloaded yet
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/7.jpg not downloaded yet
2026-03-27 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/8.jpg not downloaded yet
2026-03-27 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/9.jpg not downloaded yet
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/10.jpg not downloaded yet
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6bc7d221-6f82-5388-b754-2709f55fe80c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 6bc7d221-6f82-5388-b754-2709f55fe80c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6bc7d221-6f82-5388-b754-2709f55fe80c with identifier: 1987764
2026-03-27 22:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6bc7d221-6f82-5388-b754-2709f55fe80c with identifier: 1987764
2026-03-27 22:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6bc7d221-6f82-5388-b754-2709f55fe80c with identifier: 1987764 to the API
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6bc7d221-6f82-5388-b754-2709f55fe80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 36770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7d221-6f82-5388-b754-2709f55fe80c/6bc7d221-6f82-5388-b754-2709f55fe80c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/126dc45722604503ab61cf3bbd4e3b46/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987764%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [ayvens.be] INFO: Saving data for 1987764: {'created_time': 1774651800.884081, 'last_price_update_time': 1774651800.884093, 'auction_closing_time': 1775115000.0}
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987764') HTTP/1.1" 204 0
2026-03-27 22:50:00 [ayvens.be] INFO: Found listing with ID: 1987768
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987768%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [ayvens.be] INFO: Scrape type for 1987768: 1
2026-03-27 22:50:00 [ayvens.be] INFO: Extracting data for car ID: 1987768
2026-03-27 22:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05042e9c-3433-503d-b6e8-2174bb122ce2 with identifier: 1987768
2026-03-27 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05042e9c-3433-503d-b6e8-2174bb122ce2 with scrape type 1
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/1.jpg not downloaded yet
2026-03-27 22:50:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 6bc7d221-6f82-5388-b754-2709f55fe80c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4581790>
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/5.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/2.jpg not downloaded yet
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/3.jpg not downloaded yet
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ed950>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/6.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571bb50>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/2.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d7d10>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/1.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549790>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/8.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/4.jpg not downloaded yet
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/5.jpg not downloaded yet
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44ff8d0>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252F588af6166c7040c8b958ff108fe80570%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/9.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bde50>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/1.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/6.jpg not downloaded yet
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/7.jpg not downloaded yet
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/8.jpg not downloaded yet
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4598790>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/9.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/9.jpg not downloaded yet
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/10.jpg not downloaded yet
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5e11450>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/6.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7d90>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/8.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4595bd0>
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/4.jpg saved to cache
2026-03-27 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:01 [ayvens.be] INFO: Found listing with ID: 1987502
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987502%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [ayvens.be] INFO: Scrape type for 1987502: 1
2026-03-27 22:50:02 [ayvens.be] INFO: Extracting data for car ID: 1987502
2026-03-27 22:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e766d7c7-5ddf-5382-bdb5-fa309286f765 with identifier: 1987502
2026-03-27 22:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e766d7c7-5ddf-5382-bdb5-fa309286f765 with scrape type 1
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/1.jpg not downloaded yet
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/2.jpg not downloaded yet
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/3.jpg not downloaded yet
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560e790>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/5.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/4.jpg not downloaded yet
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/5.jpg not downloaded yet
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5689050>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/7.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5692d50>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/1.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d39d0>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/2.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/6.jpg not downloaded yet
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/7.jpg not downloaded yet
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/8.jpg not downloaded yet
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458cd50>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/10.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d559bc10>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F6a073065850044b792dbdb988c50237b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/5.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/9.jpg not downloaded yet
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/10.jpg not downloaded yet
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c3110>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/10.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568fd10>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/9.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5462fd0>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/4.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:02 [ayvens.be] INFO: Found listing with ID: 1987503
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987503%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [ayvens.be] INFO: Scrape type for 1987503: 1
2026-03-27 22:50:02 [ayvens.be] INFO: Extracting data for car ID: 1987503
2026-03-27 22:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with identifier: 1987503
2026-03-27 22:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with scrape type 1
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/1.jpg not downloaded yet
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/2.jpg not downloaded yet
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/3.jpg not downloaded yet
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568ed90>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/3.jpg saved to cache
2026-03-27 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44cb750>
2026-03-27 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/5.jpg saved to cache
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/4.jpg not downloaded yet
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/5.jpg not downloaded yet
2026-03-27 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/6.jpg not downloaded yet
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/7.jpg not downloaded yet
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/8.jpg not downloaded yet
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/9.jpg not downloaded yet
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5692610>
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fbbb6ed54120d45038da77943704274c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/8.jpg saved to cache
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7
2026-03-27 22:50:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7, skipping ID generation
2026-03-27 22:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with scrape type 1
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 sending to next pipeline
2026-03-27 22:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7, identifier: 1987767
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5432ad0>
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/7.jpg saved to cache
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5555150>
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/8.jpg saved to cache
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547fed0>
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F36d4a8446a5341a19c9d2b5897c79675%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/10.jpg saved to cache
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05042e9c-3433-503d-b6e8-2174bb122ce2
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/10.jpg not downloaded yet
2026-03-27 22:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with identifier: 1987767
2026-03-27 22:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with identifier: 1987767
2026-03-27 22:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e0aef88-4ab8-564d-b9b6-0c287eef51b7 with identifier: 1987767 to the API
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6e0aef88-4ab8-564d-b9b6-0c287eef51b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 117882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0aef88-4ab8-564d-b9b6-0c287eef51b7/6e0aef88-4ab8-564d-b9b6-0c287eef51b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/bbb6ed54120d45038da77943704274c1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2023}
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987767%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [ayvens.be] INFO: Saving data for 1987767: {'created_time': 1774651804.254326, 'last_price_update_time': 1774651804.254337, 'auction_closing_time': 1775115000.0}
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987767') HTTP/1.1" 204 0
2026-03-27 22:50:04 [ayvens.be] INFO: Found listing with ID: 1987504
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987504%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [ayvens.be] INFO: Scrape type for 1987504: 1
2026-03-27 22:50:04 [ayvens.be] INFO: Extracting data for car ID: 1987504
2026-03-27 22:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df194f46-03ee-511b-8f6d-26db91293ede with identifier: 1987504
2026-03-27 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df194f46-03ee-511b-8f6d-26db91293ede with scrape type 1
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df194f46-03ee-511b-8f6d-26db91293ede
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/1.jpg not downloaded yet
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/2.jpg not downloaded yet
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ef4d0>
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/2.jpg saved to cache
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/3.jpg not downloaded yet
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item e766d7c7-5ddf-5382-bdb5-fa309286f765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e766d7c7-5ddf-5382-bdb5-fa309286f765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 05042e9c-3433-503d-b6e8-2174bb122ce2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/4.jpg not downloaded yet
2026-03-27 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/5.jpg not downloaded yet
2026-03-27 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/6.jpg not downloaded yet
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/7.jpg not downloaded yet
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/8.jpg not downloaded yet
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547bed0>
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/5.jpg saved to cache
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/9.jpg not downloaded yet
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45616d0>
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/6.jpg saved to cache
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/10.jpg not downloaded yet
2026-03-27 22:50:04 [ayvens.be] INFO: Found listing with ID: 1987505
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987505%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [ayvens.be] INFO: Scrape type for 1987505: 1
2026-03-27 22:50:04 [ayvens.be] INFO: Extracting data for car ID: 1987505
2026-03-27 22:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3072301-4ae2-5e7a-8eca-b224f85fe29d with identifier: 1987505
2026-03-27 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3072301-4ae2-5e7a-8eca-b224f85fe29d with scrape type 1
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/1.jpg not downloaded yet
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5479bd0>
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/4.jpg saved to cache
2026-03-27 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e5e10>
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/7.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52de250>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/8.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/2.jpg not downloaded yet
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/3.jpg not downloaded yet
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/4.jpg not downloaded yet
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/5.jpg not downloaded yet
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/6.jpg not downloaded yet
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/7.jpg not downloaded yet
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/8.jpg not downloaded yet
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/9.jpg not downloaded yet
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3e3818f50>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/2.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/10.jpg not downloaded yet
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5332710>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/3.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566a490>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/1.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:05 [ayvens.be] INFO: Found listing with ID: 1987506
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987506%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [ayvens.be] INFO: Scrape type for 1987506: 1
2026-03-27 22:50:05 [ayvens.be] INFO: Extracting data for car ID: 1987506
2026-03-27 22:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef3e486-7672-5522-8b98-9859838a9025 with identifier: 1987506
2026-03-27 22:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef3e486-7672-5522-8b98-9859838a9025 with scrape type 1
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/1.jpg not downloaded yet
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/2.jpg not downloaded yet
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e5310>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc539835abacb48c08fd423396c71b2d5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/10.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e766d7c7-5ddf-5382-bdb5-fa309286f765
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54316d0>
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/5.jpg saved to cache
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/3.jpg not downloaded yet
2026-03-27 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05042e9c-3433-503d-b6e8-2174bb122ce2 with identifier: 1987768
2026-03-27 22:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05042e9c-3433-503d-b6e8-2174bb122ce2 with identifier: 1987768
2026-03-27 22:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05042e9c-3433-503d-b6e8-2174bb122ce2 with identifier: 1987768 to the API
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:06 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '05042e9c-3433-503d-b6e8-2174bb122ce2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 83558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05042e9c-3433-503d-b6e8-2174bb122ce2/05042e9c-3433-503d-b6e8-2174bb122ce2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/36d4a8446a5341a19c9d2b5897c79675/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 TECHNO',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 TECHNO',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987768%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [ayvens.be] INFO: Saving data for 1987768: {'created_time': 1774651806.336668, 'last_price_update_time': 1774651806.336678, 'auction_closing_time': 1775115000.0}
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987768') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 05042e9c-3433-503d-b6e8-2174bb122ce2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/4.jpg not downloaded yet
2026-03-27 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/5.jpg not downloaded yet
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54a9790>
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/2.jpg saved to cache
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df194f46-03ee-511b-8f6d-26db91293ede
2026-03-27 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/6.jpg not downloaded yet
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/7.jpg not downloaded yet
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/8.jpg not downloaded yet
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458e590>
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/7.jpg saved to cache
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566c390>
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/9.jpg saved to cache
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/9.jpg not downloaded yet
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/10.jpg not downloaded yet
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fc810>
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/8.jpg saved to cache
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459ad90>
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/3.jpg saved to cache
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df194f46-03ee-511b-8f6d-26db91293ede
2026-03-27 22:50:06 [ayvens.be] INFO: Found listing with ID: 1987507
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987507%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [ayvens.be] INFO: Scrape type for 1987507: 1
2026-03-27 22:50:06 [ayvens.be] INFO: Extracting data for car ID: 1987507
2026-03-27 22:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77cf9383-4509-5ac2-8a85-25d719a46c10 with identifier: 1987507
2026-03-27 22:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77cf9383-4509-5ac2-8a85-25d719a46c10 with scrape type 1
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/1.jpg not downloaded yet
2026-03-27 22:50:06 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at -1 pages/min), scraped 159 items (at 30 items/min)
2026-03-27 22:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/2.jpg not downloaded yet
2026-03-27 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/3.jpg not downloaded yet
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/4.jpg not downloaded yet
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/5.jpg not downloaded yet
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/6.jpg not downloaded yet
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/7.jpg not downloaded yet
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5315790>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/2.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/8.jpg not downloaded yet
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/9.jpg not downloaded yet
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5551d50>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/3.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56314d0>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/4.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c9750>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/5.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5688f10>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/1.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/10.jpg not downloaded yet
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [ayvens.be] INFO: Found listing with ID: 1987508
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987508%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [ayvens.be] INFO: Scrape type for 1987508: 1
2026-03-27 22:50:07 [ayvens.be] INFO: Extracting data for car ID: 1987508
2026-03-27 22:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bceadae5-c486-5a22-ba10-2efcc4383af9 with identifier: 1987508
2026-03-27 22:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceadae5-c486-5a22-ba10-2efcc4383af9 with scrape type 1
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/1.jpg not downloaded yet
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/2.jpg not downloaded yet
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53424d0>
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/2.jpg saved to cache
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/3.jpg not downloaded yet
2026-03-27 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/4.jpg not downloaded yet
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4581710>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/4.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/5.jpg not downloaded yet
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/6.jpg not downloaded yet
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/7.jpg not downloaded yet
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5557810>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/3.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5652c90>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/5.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52c8e50>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/8.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/8.jpg not downloaded yet
2026-03-27 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 3ef3e486-7672-5522-8b98-9859838a9025 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/9.jpg not downloaded yet
2026-03-27 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/10.jpg not downloaded yet
2026-03-27 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:08 [ayvens.be] INFO: Found listing with ID: 1987509
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987509%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [ayvens.be] INFO: Scrape type for 1987509: 1
2026-03-27 22:50:08 [ayvens.be] INFO: Extracting data for car ID: 1987509
2026-03-27 22:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cae3708-f033-58bd-afa3-817ac4b612d3 with identifier: 1987509
2026-03-27 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cae3708-f033-58bd-afa3-817ac4b612d3 with scrape type 1
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/1.jpg not downloaded yet
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/2.jpg not downloaded yet
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e1d90>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/9.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/3.jpg not downloaded yet
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5587610>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/10.jpg saved to cache
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/4.jpg not downloaded yet
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/5.jpg not downloaded yet
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea3a10>
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/1.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55cacd0>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/2.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2fd0>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252Fb363b58133bd4ce8ad8515e818b6009b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/8.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ef3e486-7672-5522-8b98-9859838a9025
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/6.jpg not downloaded yet
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/7.jpg not downloaded yet
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/8.jpg not downloaded yet
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/9.jpg not downloaded yet
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/10.jpg not downloaded yet
2026-03-27 22:50:09 [ayvens.be] INFO: Found listing with ID: 1987510
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987510%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [ayvens.be] INFO: Scrape type for 1987510: 1
2026-03-27 22:50:09 [ayvens.be] INFO: Extracting data for car ID: 1987510
2026-03-27 22:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab88a48a-1bf8-5014-8349-39027b41b829 with identifier: 1987510
2026-03-27 22:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab88a48a-1bf8-5014-8349-39027b41b829 with scrape type 1
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/1.jpg not downloaded yet
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/2.jpg not downloaded yet
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4517f10>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/1.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/3.jpg not downloaded yet
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7e90>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/9.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44d30d0>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/2.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55eea10>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/10.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5689a10>
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/8.jpg saved to cache
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/4.jpg not downloaded yet
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/5.jpg not downloaded yet
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/6.jpg not downloaded yet
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/7.jpg not downloaded yet
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/8.jpg not downloaded yet
2026-03-27 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 77cf9383-4509-5ac2-8a85-25d719a46c10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 3ef3e486-7672-5522-8b98-9859838a9025 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ef3e486-7672-5522-8b98-9859838a9025 with identifier: 1987506
2026-03-27 22:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ef3e486-7672-5522-8b98-9859838a9025 with identifier: 1987506
2026-03-27 22:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ef3e486-7672-5522-8b98-9859838a9025 with identifier: 1987506 to the API
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:10 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ef3e486-7672-5522-8b98-9859838a9025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 47832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef3e486-7672-5522-8b98-9859838a9025/3ef3e486-7672-5522-8b98-9859838a9025_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/b363b58133bd4ce8ad8515e818b6009b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987506%27 HTTP/1.1" 200 None
2026-03-27 22:50:10 [ayvens.be] INFO: Saving data for 1987506: {'created_time': 1774651810.616253, 'last_price_update_time': 1774651810.616264, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987506') HTTP/1.1" 204 0
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/9.jpg not downloaded yet
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 3ef3e486-7672-5522-8b98-9859838a9025 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/10.jpg not downloaded yet
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55edd90>
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/4.jpg saved to cache
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4595b10>
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/3.jpg saved to cache
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:10 [ayvens.be] INFO: Found listing with ID: 1987511
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987511%27 HTTP/1.1" 200 None
2026-03-27 22:50:10 [ayvens.be] INFO: Scrape type for 1987511: 1
2026-03-27 22:50:10 [ayvens.be] INFO: Extracting data for car ID: 1987511
2026-03-27 22:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8189d5b-2c34-56f3-8f57-11cdea2120bc with identifier: 1987511
2026-03-27 22:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8189d5b-2c34-56f3-8f57-11cdea2120bc with scrape type 1
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/1.jpg not downloaded yet
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1590>
2026-03-27 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/6.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45839d0>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/7.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5485650>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252Fa040390f5397487985eb1e6fc1721abb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/7.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77cf9383-4509-5ac2-8a85-25d719a46c10
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item bceadae5-c486-5a22-ba10-2efcc4383af9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item bceadae5-c486-5a22-ba10-2efcc4383af9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item bceadae5-c486-5a22-ba10-2efcc4383af9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/2.jpg not downloaded yet
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/3.jpg not downloaded yet
2026-03-27 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/4.jpg not downloaded yet
2026-03-27 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/5.jpg not downloaded yet
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/6.jpg not downloaded yet
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/7.jpg not downloaded yet
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/8.jpg not downloaded yet
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/9.jpg not downloaded yet
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5327e10>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/5.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540d350>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/7.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a6850>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/6.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fcc50>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/8.jpg saved to cache
2026-03-27 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530f590>
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/9.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/10.jpg not downloaded yet
2026-03-27 22:50:12 [ayvens.be] INFO: Found listing with ID: 1987512
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987512%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [ayvens.be] INFO: Scrape type for 1987512: 1
2026-03-27 22:50:12 [ayvens.be] INFO: Extracting data for car ID: 1987512
2026-03-27 22:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0867f8e-3048-5bb8-a9bb-3678e560940f with identifier: 1987512
2026-03-27 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0867f8e-3048-5bb8-a9bb-3678e560940f with scrape type 1
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/1.jpg not downloaded yet
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/2.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/3.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/4.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/5.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/6.jpg not downloaded yet
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/7.jpg not downloaded yet
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/8.jpg not downloaded yet
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/9.jpg not downloaded yet
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a0f50>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/1.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/10.jpg not downloaded yet
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56dd010>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/5.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [ayvens.be] INFO: Found listing with ID: 1987513
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987513%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [ayvens.be] INFO: Scrape type for 1987513: 1
2026-03-27 22:50:12 [ayvens.be] INFO: Extracting data for car ID: 1987513
2026-03-27 22:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1987513
2026-03-27 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with scrape type 1
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/1.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/2.jpg not downloaded yet
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45af4d0>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F8d40c6d480b84ea681c9dd2c37d0447f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/10.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cae3708-f033-58bd-afa3-817ac4b612d3
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a5550>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/7.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ca350>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/6.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/3.jpg not downloaded yet
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item ab88a48a-1bf8-5014-8349-39027b41b829 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item ab88a48a-1bf8-5014-8349-39027b41b829 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item ab88a48a-1bf8-5014-8349-39027b41b829 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/4.jpg not downloaded yet
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43c2b10>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/10.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2fc50>
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/9.jpg saved to cache
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/5.jpg not downloaded yet
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/6.jpg not downloaded yet
2026-03-27 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/7.jpg not downloaded yet
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/8.jpg not downloaded yet
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/9.jpg not downloaded yet
2026-03-27 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/10.jpg not downloaded yet
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5426fd0>
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/3.jpg saved to cache
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5341c50>
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/2.jpg saved to cache
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:13 [ayvens.be] INFO: Found listing with ID: 1987514
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987514%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [ayvens.be] INFO: Scrape type for 1987514: 1
2026-03-27 22:50:13 [ayvens.be] INFO: Extracting data for car ID: 1987514
2026-03-27 22:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with identifier: 1987514
2026-03-27 22:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with scrape type 1
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/1.jpg not downloaded yet
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/2.jpg not downloaded yet
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/3.jpg not downloaded yet
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d571acd0>
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F1c84bd636b064b158664d4f6e66d67b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/8.jpg saved to cache
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab88a48a-1bf8-5014-8349-39027b41b829
2026-03-27 22:50:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab88a48a-1bf8-5014-8349-39027b41b829, skipping ID generation
2026-03-27 22:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab88a48a-1bf8-5014-8349-39027b41b829 with scrape type 1
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab88a48a-1bf8-5014-8349-39027b41b829 sending to next pipeline
2026-03-27 22:50:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab88a48a-1bf8-5014-8349-39027b41b829, identifier: 1987510
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b56d0>
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/1.jpg saved to cache
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56d4450>
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/2.jpg saved to cache
2026-03-27 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab88a48a-1bf8-5014-8349-39027b41b829 with identifier: 1987510
2026-03-27 22:50:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab88a48a-1bf8-5014-8349-39027b41b829 with identifier: 1987510
2026-03-27 22:50:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab88a48a-1bf8-5014-8349-39027b41b829 with identifier: 1987510 to the API
2026-03-27 22:50:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab88a48a-1bf8-5014-8349-39027b41b829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 75028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 902626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab88a48a-1bf8-5014-8349-39027b41b829/ab88a48a-1bf8-5014-8349-39027b41b829_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/1c84bd636b064b158664d4f6e66d67b8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987510%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [ayvens.be] INFO: Saving data for 1987510: {'created_time': 1774651814.197226, 'last_price_update_time': 1774651814.197237, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987510') HTTP/1.1" 204 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/4.jpg not downloaded yet
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/5.jpg not downloaded yet
2026-03-27 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/6.jpg not downloaded yet
2026-03-27 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/7.jpg not downloaded yet
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 8cae3708-f033-58bd-afa3-817ac4b612d3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/8.jpg not downloaded yet
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/9.jpg not downloaded yet
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/10.jpg not downloaded yet
2026-03-27 22:50:14 [ayvens.be] INFO: Found listing with ID: 1987515
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987515%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [ayvens.be] INFO: Scrape type for 1987515: 1
2026-03-27 22:50:14 [ayvens.be] INFO: Extracting data for car ID: 1987515
2026-03-27 22:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac59bce-46a7-5911-ae8b-3bad79b745cf with identifier: 1987515
2026-03-27 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac59bce-46a7-5911-ae8b-3bad79b745cf with scrape type 1
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/1.jpg not downloaded yet
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/2.jpg not downloaded yet
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530d550>
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/5.jpg saved to cache
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316c50>
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/1.jpg saved to cache
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d547c910>
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/4.jpg saved to cache
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5624190>
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/3.jpg saved to cache
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d1a50>
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F287911d1cf994de2b8271f77cd24beec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/10.jpg saved to cache
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0867f8e-3048-5bb8-a9bb-3678e560940f
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/3.jpg not downloaded yet
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/4.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/5.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/6.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/7.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/8.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/9.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/10.jpg not downloaded yet
2026-03-27 22:50:15 [ayvens.be] INFO: Found listing with ID: 1987516
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987516%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [ayvens.be] INFO: Scrape type for 1987516: 1
2026-03-27 22:50:15 [ayvens.be] INFO: Extracting data for car ID: 1987516
2026-03-27 22:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with identifier: 1987516
2026-03-27 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with scrape type 1
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/1.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/2.jpg not downloaded yet
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b1c50>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/7.jpg saved to cache
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d796a4d0>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/3.jpg saved to cache
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5431490>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/4.jpg saved to cache
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45533d0>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/8.jpg saved to cache
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5625010>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/6.jpg saved to cache
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/3.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/4.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/5.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/6.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/7.jpg not downloaded yet
2026-03-27 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/8.jpg not downloaded yet
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c0867f8e-3048-5bb8-a9bb-3678e560940f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c0867f8e-3048-5bb8-a9bb-3678e560940f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c0867f8e-3048-5bb8-a9bb-3678e560940f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/9.jpg not downloaded yet
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/10.jpg not downloaded yet
2026-03-27 22:50:15 [ayvens.be] INFO: Found listing with ID: 1987517
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987517%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [ayvens.be] INFO: Scrape type for 1987517: 1
2026-03-27 22:50:15 [ayvens.be] INFO: Extracting data for car ID: 1987517
2026-03-27 22:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with identifier: 1987517
2026-03-27 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with scrape type 1
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/1.jpg not downloaded yet
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fcc90>
2026-03-27 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/3.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/2.jpg not downloaded yet
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4507550>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/2.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5632750>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/5.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/3.jpg not downloaded yet
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cccd0>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/1.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b03d0>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/4.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/4.jpg not downloaded yet
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/5.jpg not downloaded yet
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/6.jpg not downloaded yet
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/7.jpg not downloaded yet
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/8.jpg not downloaded yet
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/9.jpg not downloaded yet
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/10.jpg not downloaded yet
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5565210>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/6.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:16 [ayvens.be] INFO: Found listing with ID: 1987518
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987518%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [ayvens.be] INFO: Scrape type for 1987518: 1
2026-03-27 22:50:16 [ayvens.be] INFO: Extracting data for car ID: 1987518
2026-03-27 22:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00721fc-9b25-5ba4-868f-70e1c4467dba with identifier: 1987518
2026-03-27 22:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00721fc-9b25-5ba4-868f-70e1c4467dba with scrape type 1
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/1.jpg not downloaded yet
2026-03-27 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/2.jpg not downloaded yet
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/3.jpg not downloaded yet
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b4d50>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/5.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530ced0>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/3.jpg saved to cache
2026-03-27 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478890>
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/7.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5484d50>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/4.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/4.jpg not downloaded yet
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/5.jpg not downloaded yet
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5484a90>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/2.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/6.jpg not downloaded yet
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/7.jpg not downloaded yet
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/8.jpg not downloaded yet
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45510d0>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/4.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d549ef50>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/3.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4529590>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/1.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/9.jpg not downloaded yet
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/10.jpg not downloaded yet
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d459a750>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/10.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bf710>
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/5.jpg saved to cache
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:17 [ayvens.be] INFO: Found listing with ID: 1987519
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987519%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [ayvens.be] INFO: Scrape type for 1987519: 1
2026-03-27 22:50:17 [ayvens.be] INFO: Extracting data for car ID: 1987519
2026-03-27 22:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00cb7370-3542-5583-b55d-c5803eaae08c with identifier: 1987519
2026-03-27 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cb7370-3542-5583-b55d-c5803eaae08c with scrape type 1
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/1.jpg not downloaded yet
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/2.jpg not downloaded yet
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/3.jpg not downloaded yet
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/4.jpg not downloaded yet
2026-03-27 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/5.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/6.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/7.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/8.jpg not downloaded yet
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5433e10>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/6.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/9.jpg not downloaded yet
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44b7dd0>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/2.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5567f90>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/4.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d31dd0>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/5.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/10.jpg not downloaded yet
2026-03-27 22:50:18 [ayvens.be] INFO: Found listing with ID: 1987520
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987520%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [ayvens.be] INFO: Scrape type for 1987520: 1
2026-03-27 22:50:18 [ayvens.be] INFO: Extracting data for car ID: 1987520
2026-03-27 22:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with identifier: 1987520
2026-03-27 22:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with scrape type 1
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/1.jpg not downloaded yet
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5653ed0>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/10.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/2.jpg not downloaded yet
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item dac59bce-46a7-5911-ae8b-3bad79b745cf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/3.jpg not downloaded yet
2026-03-27 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/4.jpg not downloaded yet
2026-03-27 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/5.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/6.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/7.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/8.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/9.jpg not downloaded yet
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/10.jpg not downloaded yet
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d557b090>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/9.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5624f90>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/1.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7057350>
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/3.jpg saved to cache
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:18 [ayvens.be] INFO: Found listing with ID: 1987521
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987521%27 HTTP/1.1" 200 None
2026-03-27 22:50:18 [ayvens.be] INFO: Scrape type for 1987521: 1
2026-03-27 22:50:18 [ayvens.be] INFO: Extracting data for car ID: 1987521
2026-03-27 22:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with identifier: 1987521
2026-03-27 22:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with scrape type 1
2026-03-27 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/1.jpg not downloaded yet
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5317050>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/4.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56e8d50>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/2.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/2.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/3.jpg not downloaded yet
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/4.jpg not downloaded yet
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/5.jpg not downloaded yet
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/6.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/7.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/8.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/9.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/10.jpg not downloaded yet
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458cd50>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/2.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:19 [ayvens.be] INFO: Found listing with ID: 1987522
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987522%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [ayvens.be] INFO: Scrape type for 1987522: 1
2026-03-27 22:50:19 [ayvens.be] INFO: Extracting data for car ID: 1987522
2026-03-27 22:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b30bf0-53ae-59c7-a658-2b724d4becc4 with identifier: 1987522
2026-03-27 22:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b30bf0-53ae-59c7-a658-2b724d4becc4 with scrape type 1
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/1.jpg not downloaded yet
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5549650>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/9.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ddf50>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/10.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/2.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/3.jpg not downloaded yet
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53d3f10>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/1.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d54b3610>
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/4.jpg saved to cache
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/4.jpg not downloaded yet
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f00721fc-9b25-5ba4-868f-70e1c4467dba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f00721fc-9b25-5ba4-868f-70e1c4467dba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/5.jpg not downloaded yet
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/6.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/7.jpg not downloaded yet
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/8.jpg not downloaded yet
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/9.jpg not downloaded yet
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/10.jpg not downloaded yet
2026-03-27 22:50:20 [ayvens.be] INFO: Found listing with ID: 1987523
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987523%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [ayvens.be] INFO: Scrape type for 1987523: 1
2026-03-27 22:50:20 [ayvens.be] INFO: Extracting data for car ID: 1987523
2026-03-27 22:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with identifier: 1987523
2026-03-27 22:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with scrape type 1
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/1.jpg not downloaded yet
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5598f50>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/10.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548e50>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/2.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/2.jpg not downloaded yet
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5316410>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/8.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55a4190>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/9.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5693fd0>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/3.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/3.jpg not downloaded yet
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/4.jpg not downloaded yet
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/5.jpg not downloaded yet
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/6.jpg not downloaded yet
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/7.jpg not downloaded yet
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/8.jpg not downloaded yet
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/9.jpg not downloaded yet
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d43b5d90>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/4.jpg saved to cache
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/10.jpg not downloaded yet
2026-03-27 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458d8d0>
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/3.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53b8e90>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/5.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d169d0>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/2.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d541a590>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/1.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:21 [ayvens.be] INFO: Found listing with ID: 1987524
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987524%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [ayvens.be] INFO: Scrape type for 1987524: 1
2026-03-27 22:50:21 [ayvens.be] INFO: Extracting data for car ID: 1987524
2026-03-27 22:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00f00e3-e700-5485-91e9-0c747fbd89d9 with identifier: 1987524
2026-03-27 22:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00f00e3-e700-5485-91e9-0c747fbd89d9 with scrape type 1
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/1.jpg not downloaded yet
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 00cb7370-3542-5583-b55d-c5803eaae08c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/2.jpg not downloaded yet
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4561590>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/2.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/3.jpg not downloaded yet
2026-03-27 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/4.jpg not downloaded yet
2026-03-27 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/5.jpg not downloaded yet
2026-03-27 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/6.jpg not downloaded yet
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/7.jpg not downloaded yet
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/8.jpg not downloaded yet
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53c4790>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/1.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/9.jpg not downloaded yet
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/10.jpg not downloaded yet
2026-03-27 22:50:21 [ayvens.be] INFO: Found listing with ID: 1987525
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987525%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [ayvens.be] INFO: Scrape type for 1987525: 1
2026-03-27 22:50:21 [ayvens.be] INFO: Extracting data for car ID: 1987525
2026-03-27 22:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f75286-e4af-5f26-af67-1083541d5b3c with identifier: 1987525
2026-03-27 22:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f75286-e4af-5f26-af67-1083541d5b3c with scrape type 1
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1f75286-e4af-5f26-af67-1083541d5b3c
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/1.jpg not downloaded yet
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5684690>
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/10.jpg saved to cache
2026-03-27 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7318890>
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/4.jpg saved to cache
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5684750>
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/3.jpg saved to cache
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55cb9d0>
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/6.jpg saved to cache
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/2.jpg not downloaded yet
2026-03-27 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/3.jpg not downloaded yet
2026-03-27 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/4.jpg not downloaded yet
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/5.jpg not downloaded yet
2026-03-27 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/6.jpg not downloaded yet
2026-03-27 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/7.jpg not downloaded yet
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/8.jpg not downloaded yet
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/9.jpg not downloaded yet
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ad7d0>
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/4.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/10.jpg not downloaded yet
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d708e4d0>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/9.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:23 [ayvens.be] INFO: Found listing with ID: 1987526
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987526%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [ayvens.be] INFO: Scrape type for 1987526: 1
2026-03-27 22:50:23 [ayvens.be] INFO: Extracting data for car ID: 1987526
2026-03-27 22:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e5ac17-6468-5027-87a7-a95975e2b78e with identifier: 1987526
2026-03-27 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e5ac17-6468-5027-87a7-a95975e2b78e with scrape type 1
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/1.jpg not downloaded yet
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/2.jpg not downloaded yet
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566ebd0>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/5.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55c97d0>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/3.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52df990>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/1.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/3.jpg not downloaded yet
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/4.jpg not downloaded yet
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/5.jpg not downloaded yet
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/6.jpg not downloaded yet
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/7.jpg not downloaded yet
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/8.jpg not downloaded yet
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/9.jpg not downloaded yet
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/10.jpg not downloaded yet
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7056010>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/2.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531c8d0>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/3.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e0f10>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/5.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5386f50>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/4.jpg saved to cache
2026-03-27 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:23 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-27 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d44e2f50>
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/1.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d79490>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/10.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45ad750>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/1.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1f75286-e4af-5f26-af67-1083541d5b3c
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4528a10>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/9.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d722c950>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/8.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d452bc90>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/2.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1f75286-e4af-5f26-af67-1083541d5b3c
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4532650>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/4.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a2790>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/2.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d566fd10>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/1.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e776d0>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/3.jpg saved to cache
2026-03-27 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7ab28d0>
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/6.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5695090>
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/10.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a0690>
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/8.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55517d0>
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/9.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5f0a5d0>
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/7.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56a62d0>
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xl%252F5da63032d1854e3ba2d68159ccd8dea4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/5.jpg saved to cache
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44e5ac17-6468-5027-87a7-a95975e2b78e
2026-03-27 22:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44e5ac17-6468-5027-87a7-a95975e2b78e, skipping ID generation
2026-03-27 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e5ac17-6468-5027-87a7-a95975e2b78e with scrape type 1
2026-03-27 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44e5ac17-6468-5027-87a7-a95975e2b78e sending to next pipeline
2026-03-27 22:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44e5ac17-6468-5027-87a7-a95975e2b78e, identifier: 1987526
2026-03-27 22:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44e5ac17-6468-5027-87a7-a95975e2b78e with identifier: 1987526
2026-03-27 22:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44e5ac17-6468-5027-87a7-a95975e2b78e with identifier: 1987526
2026-03-27 22:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44e5ac17-6468-5027-87a7-a95975e2b78e with identifier: 1987526 to the API
2026-03-27 22:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '44e5ac17-6468-5027-87a7-a95975e2b78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 99303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e5ac17-6468-5027-87a7-a95975e2b78e/44e5ac17-6468-5027-87a7-a95975e2b78e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xl/5da63032d1854e3ba2d68159ccd8dea4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987526%27 HTTP/1.1" 200 None
2026-03-27 22:50:26 [ayvens.be] INFO: Saving data for 1987526: {'created_time': 1774651826.244131, 'last_price_update_time': 1774651826.24414, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987526') HTTP/1.1" 204 0
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4531c50>
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/6.jpg saved to cache
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item d1f75286-e4af-5f26-af67-1083541d5b3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:26 [ayvens.be] INFO: Found listing with ID: 1987527
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987527%27 HTTP/1.1" 200 None
2026-03-27 22:50:26 [ayvens.be] INFO: Scrape type for 1987527: 1
2026-03-27 22:50:26 [ayvens.be] INFO: Extracting data for car ID: 1987527
2026-03-27 22:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ad8eda-4aa3-588c-a141-b800f400eb2c with identifier: 1987527
2026-03-27 22:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ad8eda-4aa3-588c-a141-b800f400eb2c with scrape type 1
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/1.jpg not downloaded yet
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4532710>
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/7.jpg saved to cache
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1f75286-e4af-5f26-af67-1083541d5b3c
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/2.jpg not downloaded yet
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5497310>
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F7eba69ca9e62492d806106304cbc949e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/6.jpg saved to cache
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1f75286-e4af-5f26-af67-1083541d5b3c
2026-03-27 22:50:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1f75286-e4af-5f26-af67-1083541d5b3c, skipping ID generation
2026-03-27 22:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f75286-e4af-5f26-af67-1083541d5b3c with scrape type 1
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1f75286-e4af-5f26-af67-1083541d5b3c sending to next pipeline
2026-03-27 22:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1f75286-e4af-5f26-af67-1083541d5b3c, identifier: 1987525
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e635d0>
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F09997c762b9a4be6afc596df3ed55982%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/7.jpg saved to cache
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d00f00e3-e700-5485-91e9-0c747fbd89d9
2026-03-27 22:50:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d00f00e3-e700-5485-91e9-0c747fbd89d9, skipping ID generation
2026-03-27 22:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00f00e3-e700-5485-91e9-0c747fbd89d9 with scrape type 1
2026-03-27 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d00f00e3-e700-5485-91e9-0c747fbd89d9 sending to next pipeline
2026-03-27 22:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d00f00e3-e700-5485-91e9-0c747fbd89d9, identifier: 1987524
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4505f10>
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffefac4dab88a4476995bb0b62d5043df%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/10.jpg saved to cache
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5556b50>
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F8e95e264daa345e58d1e5866a6cc62bc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/10.jpg saved to cache
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765
2026-03-27 22:50:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765, skipping ID generation
2026-03-27 22:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with scrape type 1
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 sending to next pipeline
2026-03-27 22:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765, identifier: 1987523
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/3.jpg not downloaded yet
2026-03-27 22:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1f75286-e4af-5f26-af67-1083541d5b3c with identifier: 1987525
2026-03-27 22:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1f75286-e4af-5f26-af67-1083541d5b3c with identifier: 1987525
2026-03-27 22:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1f75286-e4af-5f26-af67-1083541d5b3c with identifier: 1987525 to the API
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd1f75286-e4af-5f26-af67-1083541d5b3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 116331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f75286-e4af-5f26-af67-1083541d5b3c/d1f75286-e4af-5f26-af67-1083541d5b3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/7eba69ca9e62492d806106304cbc949e/images/large/7.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987525%27 HTTP/1.1" 200 None
2026-03-27 22:50:27 [ayvens.be] INFO: Saving data for 1987525: {'created_time': 1774651827.699172, 'last_price_update_time': 1774651827.69918, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987525') HTTP/1.1" 204 0
2026-03-27 22:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d00f00e3-e700-5485-91e9-0c747fbd89d9 with identifier: 1987524
2026-03-27 22:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d00f00e3-e700-5485-91e9-0c747fbd89d9 with identifier: 1987524
2026-03-27 22:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d00f00e3-e700-5485-91e9-0c747fbd89d9 with identifier: 1987524 to the API
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd00f00e3-e700-5485-91e9-0c747fbd89d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 105405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00f00e3-e700-5485-91e9-0c747fbd89d9/d00f00e3-e700-5485-91e9-0c747fbd89d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/09997c762b9a4be6afc596df3ed55982/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987524%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [ayvens.be] INFO: Saving data for 1987524: {'created_time': 1774651828.104769, 'last_price_update_time': 1774651828.104779, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987524') HTTP/1.1" 204 0
2026-03-27 22:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with identifier: 1987523
2026-03-27 22:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with identifier: 1987523
2026-03-27 22:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62812f4b-78b2-5ecd-b7ec-a0a40c2f3765 with identifier: 1987523 to the API
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '62812f4b-78b2-5ecd-b7ec-a0a40c2f3765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 61204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62812f4b-78b2-5ecd-b7ec-a0a40c2f3765/62812f4b-78b2-5ecd-b7ec-a0a40c2f3765_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/8e95e264daa345e58d1e5866a6cc62bc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 CONFORT',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987523%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [ayvens.be] INFO: Saving data for 1987523: {'created_time': 1774651828.477511, 'last_price_update_time': 1774651828.477521, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987523') HTTP/1.1" 204 0
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/4.jpg not downloaded yet
2026-03-27 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/5.jpg not downloaded yet
2026-03-27 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/6.jpg not downloaded yet
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/7.jpg not downloaded yet
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/8.jpg not downloaded yet
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 83b30bf0-53ae-59c7-a658-2b724d4becc4 with identifier: 1987522
2026-03-27 22:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 83b30bf0-53ae-59c7-a658-2b724d4becc4 with identifier: 1987522
2026-03-27 22:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 83b30bf0-53ae-59c7-a658-2b724d4becc4 with identifier: 1987522 to the API
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '83b30bf0-53ae-59c7-a658-2b724d4becc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 53848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b30bf0-53ae-59c7-a658-2b724d4becc4/83b30bf0-53ae-59c7-a658-2b724d4becc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fefac4dab88a4476995bb0b62d5043df/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987522%27 HTTP/1.1" 200 None
2026-03-27 22:50:28 [ayvens.be] INFO: Saving data for 1987522: {'created_time': 1774651828.958688, 'last_price_update_time': 1774651828.958698, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987522') HTTP/1.1" 204 0
2026-03-27 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/9.jpg not downloaded yet
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 83b30bf0-53ae-59c7-a658-2b724d4becc4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/10.jpg not downloaded yet
2026-03-27 22:50:29 [ayvens.be] INFO: Found listing with ID: 1987528
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987528%27 HTTP/1.1" 200 None
2026-03-27 22:50:29 [ayvens.be] INFO: Scrape type for 1987528: 1
2026-03-27 22:50:29 [ayvens.be] INFO: Extracting data for car ID: 1987528
2026-03-27 22:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with identifier: 1987528
2026-03-27 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with scrape type 1
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/1.jpg not downloaded yet
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560fc90>
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/6.jpg saved to cache
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548390>
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/9.jpg saved to cache
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5478cd0>
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/7.jpg saved to cache
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d3d10>
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F2181a75a3d044286b68d1fe67ccdf0d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/8.jpg saved to cache
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6
2026-03-27 22:50:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6, skipping ID generation
2026-03-27 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with scrape type 1
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 sending to next pipeline
2026-03-27 22:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6, identifier: 1987521
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5ac0ad0>
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/10.jpg saved to cache
2026-03-27 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with identifier: 1987521
2026-03-27 22:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with identifier: 1987521
2026-03-27 22:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46fa5fdd-ef4f-5d89-96de-18b8b30f65d6 with identifier: 1987521 to the API
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '46fa5fdd-ef4f-5d89-96de-18b8b30f65d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 73317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46fa5fdd-ef4f-5d89-96de-18b8b30f65d6/46fa5fdd-ef4f-5d89-96de-18b8b30f65d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/2181a75a3d044286b68d1fe67ccdf0d4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-23',
 'seats_number': 1,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB 1 pl',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987521%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Saving data for 1987521: {'created_time': 1774651830.077387, 'last_price_update_time': 1774651830.077397, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987521') HTTP/1.1" 204 0
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/2.jpg not downloaded yet
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/3.jpg not downloaded yet
2026-03-27 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/4.jpg not downloaded yet
2026-03-27 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/5.jpg not downloaded yet
2026-03-27 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/6.jpg not downloaded yet
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/7.jpg not downloaded yet
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/8.jpg not downloaded yet
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/9.jpg not downloaded yet
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52d1c90>
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/3.jpg saved to cache
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ade90>
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/5.jpg saved to cache
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/10.jpg not downloaded yet
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982154
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982154: 2
2026-03-27 22:50:30 [ayvens.be] INFO: Extracting data for car ID: 1982154
2026-03-27 22:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-27 22:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 2
2026-03-27 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 2
2026-03-27 22:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2adc822b-9525-57aa-a6fd-5dac6ff9009c, identifier: 1982154
2026-03-27 22:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-27 22:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-27 22:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154 to the API
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '2adc822b-9525-57aa-a6fd-5dac6ff9009c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Saving data for 1982154: {'auction_closing_time': 1775037600.0, 'created_time': 1774478725.315373, 'last_price_update_time': 1774651830.803617}
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982154') HTTP/1.1" 204 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982155
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982155%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982155: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982156
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982156%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982156: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982157
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982157%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982157: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982158
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982158%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982158: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982159
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982159%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982159: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982160
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982160%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982160: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982161
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982161%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982161: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982162
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982162%27 HTTP/1.1" 200 None
2026-03-27 22:50:30 [ayvens.be] INFO: Scrape type for 1982162: 0
2026-03-27 22:50:30 [ayvens.be] INFO: Found listing with ID: 1982163
2026-03-27 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982163%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982163: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982164
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982164%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982164: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982165
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982165%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982165: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982166
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982166%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982166: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982167
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982167%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982167: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982168
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982168%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982168: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982169
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982169%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982169: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982170
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982170%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982170: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982171
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982171%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982171: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982172
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982172%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982172: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982173
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982173%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982173: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982174
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982174%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982174: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982175
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982175%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982175: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982176
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982176%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982176: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982177
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982177%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982177: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982178
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982178%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982178: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982179
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982179%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982179: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982180
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982180%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982180: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982181
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982181%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982181: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982182
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982182%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982182: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982183
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982183%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982183: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982184
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982184%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982184: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982185
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982185%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982185: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982186
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982186%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982186: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982187
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982187%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982187: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982188
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982188%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982188: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982189
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982189%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982189: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982190
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982190%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982190: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982191
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982191%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982191: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982192
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982192%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982192: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982193
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982193%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982193: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982194
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982194%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982194: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982195
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982195%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982195: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982196
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982196%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982196: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982197
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982197%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982197: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982198
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982198%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982198: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982199
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982199%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982199: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982200
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982200%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982200: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982201
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982201%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982201: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982202
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982202%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982202: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982203
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982203%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982203: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982204
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982204%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982204: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982205
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982205%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982205: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982206
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982206%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982206: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982207
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982207%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982207: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982208
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982208%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1982208: 0
2026-03-27 22:50:31 [ayvens.be] INFO: Found listing with ID: 1986030
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986030%27 HTTP/1.1" 200 None
2026-03-27 22:50:31 [ayvens.be] INFO: Scrape type for 1986030: 2
2026-03-27 22:50:31 [ayvens.be] INFO: Extracting data for car ID: 1986030
2026-03-27 22:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-27 22:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with scrape type 2
2026-03-27 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with scrape type 2
2026-03-27 22:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bef7e0b6-b1d5-5839-a4f0-59265aa25b31, identifier: 1986030
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bf250>
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F488afc70b4dc4cc38e9e9bfef38689bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/6.jpg saved to cache
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00cb7370-3542-5583-b55d-c5803eaae08c
2026-03-27 22:50:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00cb7370-3542-5583-b55d-c5803eaae08c, skipping ID generation
2026-03-27 22:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cb7370-3542-5583-b55d-c5803eaae08c with scrape type 1
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00cb7370-3542-5583-b55d-c5803eaae08c sending to next pipeline
2026-03-27 22:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00cb7370-3542-5583-b55d-c5803eaae08c, identifier: 1987519
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ff810>
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/8.jpg saved to cache
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d53cc950>
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F581981b285654c5f89de14467ccb8a0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/5.jpg saved to cache
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254
2026-03-27 22:50:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254, skipping ID generation
2026-03-27 22:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with scrape type 1
2026-03-27 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 sending to next pipeline
2026-03-27 22:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254, identifier: 1987520
2026-03-27 22:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-27 22:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-27 22:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030 to the API
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bef7e0b6-b1d5-5839-a4f0-59265aa25b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 117305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986030%27 HTTP/1.1" 200 None
2026-03-27 22:50:32 [ayvens.be] INFO: Saving data for 1986030: {'auction_closing_time': 1775028600.0, 'created_time': 1774565134.638848, 'last_price_update_time': 1774651832.875766}
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986030') HTTP/1.1" 204 0
2026-03-27 22:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00cb7370-3542-5583-b55d-c5803eaae08c with identifier: 1987519
2026-03-27 22:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00cb7370-3542-5583-b55d-c5803eaae08c with identifier: 1987519
2026-03-27 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00cb7370-3542-5583-b55d-c5803eaae08c with identifier: 1987519 to the API
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '00cb7370-3542-5583-b55d-c5803eaae08c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 58194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00cb7370-3542-5583-b55d-c5803eaae08c/00cb7370-3542-5583-b55d-c5803eaae08c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/488afc70b4dc4cc38e9e9bfef38689bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987519%27 HTTP/1.1" 200 None
2026-03-27 22:50:33 [ayvens.be] INFO: Saving data for 1987519: {'created_time': 1774651833.335537, 'last_price_update_time': 1774651833.335548, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987519') HTTP/1.1" 204 0
2026-03-27 22:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with identifier: 1987520
2026-03-27 22:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with identifier: 1987520
2026-03-27 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254 with identifier: 1987520 to the API
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 56961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254/1e4fa914-a6aa-5ba8-b2a5-ae963bc0e254_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/581981b285654c5f89de14467ccb8a0a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 1,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987520%27 HTTP/1.1" 200 None
2026-03-27 22:50:33 [ayvens.be] INFO: Saving data for 1987520: {'created_time': 1774651833.676392, 'last_price_update_time': 1774651833.676403, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987520') HTTP/1.1" 204 0
2026-03-27 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:33 [ayvens.be] INFO: Found listing with ID: 1986031
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986031%27 HTTP/1.1" 200 None
2026-03-27 22:50:33 [ayvens.be] INFO: Scrape type for 1986031: 2
2026-03-27 22:50:33 [ayvens.be] INFO: Extracting data for car ID: 1986031
2026-03-27 22:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-27 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c10ba7-dcda-584c-b6d0-87c4bf987176 with scrape type 2
2026-03-27 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c10ba7-dcda-584c-b6d0-87c4bf987176 with scrape type 2
2026-03-27 22:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8c10ba7-dcda-584c-b6d0-87c4bf987176, identifier: 1986031
2026-03-27 22:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-27 22:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-27 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031 to the API
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f8c10ba7-dcda-584c-b6d0-87c4bf987176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 67891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986031%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Saving data for 1986031: {'auction_closing_time': 1775028600.0, 'created_time': 1774565140.133907, 'last_price_update_time': 1774651834.091317}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986031') HTTP/1.1" 204 0
2026-03-27 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:34 [ayvens.be] INFO: Found listing with ID: 1986032
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986032%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Scrape type for 1986032: 2
2026-03-27 22:50:34 [ayvens.be] INFO: Extracting data for car ID: 1986032
2026-03-27 22:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-27 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with scrape type 2
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with scrape type 2
2026-03-27 22:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8, identifier: 1986032
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-27 22:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-27 22:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032 to the API
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 92238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986032%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Saving data for 1986032: {'auction_closing_time': 1775028600.0, 'created_time': 1774565137.768081, 'last_price_update_time': 1774651834.476874}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986032') HTTP/1.1" 204 0
2026-03-27 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:34 [ayvens.be] INFO: Found listing with ID: 1986033
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986033%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Scrape type for 1986033: 2
2026-03-27 22:50:34 [ayvens.be] INFO: Extracting data for car ID: 1986033
2026-03-27 22:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-27 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d534795d-7047-5bbb-884f-a5faa15342d5 with scrape type 2
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d534795d-7047-5bbb-884f-a5faa15342d5 with scrape type 2
2026-03-27 22:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d534795d-7047-5bbb-884f-a5faa15342d5, identifier: 1986033
2026-03-27 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5615dd0>
2026-03-27 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/4.jpg saved to cache
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-27 22:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-27 22:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033 to the API
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd534795d-7047-5bbb-884f-a5faa15342d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 95016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986033%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Saving data for 1986033: {'auction_closing_time': 1775028600.0, 'created_time': 1774565138.457957, 'last_price_update_time': 1774651834.927318}
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986033') HTTP/1.1" 204 0
2026-03-27 22:50:34 [ayvens.be] INFO: Found listing with ID: 1986034
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986034%27 HTTP/1.1" 200 None
2026-03-27 22:50:34 [ayvens.be] INFO: Scrape type for 1986034: 2
2026-03-27 22:50:34 [ayvens.be] INFO: Extracting data for car ID: 1986034
2026-03-27 22:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-27 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 2
2026-03-27 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 2
2026-03-27 22:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, identifier: 1986034
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45a1b90>
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/7.jpg saved to cache
2026-03-27 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5685b10>
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F2db972fd4a5d46219ab59ca4934c0d3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/1.jpg saved to cache
2026-03-27 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5
2026-03-27 22:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5, skipping ID generation
2026-03-27 22:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with scrape type 1
2026-03-27 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 sending to next pipeline
2026-03-27 22:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5, identifier: 1987517
2026-03-27 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-27 22:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-27 22:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034 to the API
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '274ec52a-7bd4-5d37-b9e6-692b9194f3b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 107725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986034%27 HTTP/1.1" 200 None
2026-03-27 22:50:35 [ayvens.be] INFO: Saving data for 1986034: {'auction_closing_time': 1775028600.0, 'created_time': 1774565141.238941, 'last_price_update_time': 1774651835.77484}
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986034') HTTP/1.1" 204 0
2026-03-27 22:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with identifier: 1987517
2026-03-27 22:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with identifier: 1987517
2026-03-27 22:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7346a70f-b940-5e73-aad5-dcd0c8e1e3d5 with identifier: 1987517 to the API
2026-03-27 22:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '7346a70f-b940-5e73-aad5-dcd0c8e1e3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 176827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a70f-b940-5e73-aad5-dcd0c8e1e3d5/7346a70f-b940-5e73-aad5-dcd0c8e1e3d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/2db972fd4a5d46219ab59ca4934c0d3d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort (EU6)',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort (EU6)',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987517%27 HTTP/1.1" 200 None
2026-03-27 22:50:36 [ayvens.be] INFO: Saving data for 1987517: {'created_time': 1774651836.126543, 'last_price_update_time': 1774651836.126555, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987517') HTTP/1.1" 204 0
2026-03-27 22:50:36 [ayvens.be] INFO: Found listing with ID: 1986035
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986035%27 HTTP/1.1" 200 None
2026-03-27 22:50:36 [ayvens.be] INFO: Scrape type for 1986035: 2
2026-03-27 22:50:36 [ayvens.be] INFO: Extracting data for car ID: 1986035
2026-03-27 22:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-27 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 2
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 2
2026-03-27 22:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 989f5ad8-eedf-5233-b3f7-d3719562d97e, identifier: 1986035
2026-03-27 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-27 22:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-27 22:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035 to the API
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '989f5ad8-eedf-5233-b3f7-d3719562d97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 156232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986035%27 HTTP/1.1" 200 None
2026-03-27 22:50:36 [ayvens.be] INFO: Saving data for 1986035: {'auction_closing_time': 1775028600.0, 'created_time': 1774565142.827526, 'last_price_update_time': 1774651836.534157}
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986035') HTTP/1.1" 204 0
2026-03-27 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d90e50>
2026-03-27 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/5.jpg saved to cache
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:36 [ayvens.be] INFO: Found listing with ID: 1986036
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986036%27 HTTP/1.1" 200 None
2026-03-27 22:50:36 [ayvens.be] INFO: Scrape type for 1986036: 2
2026-03-27 22:50:36 [ayvens.be] INFO: Extracting data for car ID: 1986036
2026-03-27 22:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-27 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 2
2026-03-27 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 2
2026-03-27 22:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9c31b26-dc78-56c7-b825-76271aa2099c, identifier: 1986036
2026-03-27 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-27 22:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-27 22:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036 to the API
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c9c31b26-dc78-56c7-b825-76271aa2099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 131190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986036%27 HTTP/1.1" 200 None
2026-03-27 22:50:37 [ayvens.be] INFO: Saving data for 1986036: {'auction_closing_time': 1775028600.0, 'created_time': 1774565145.033028, 'last_price_update_time': 1774651837.070104}
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986036') HTTP/1.1" 204 0
2026-03-27 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56fd8d0>
2026-03-27 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fa456e1d0dc80465cafa55bb994f43db8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/6.jpg saved to cache
2026-03-27 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f00721fc-9b25-5ba4-868f-70e1c4467dba
2026-03-27 22:50:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f00721fc-9b25-5ba4-868f-70e1c4467dba, skipping ID generation
2026-03-27 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00721fc-9b25-5ba4-868f-70e1c4467dba with scrape type 1
2026-03-27 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f00721fc-9b25-5ba4-868f-70e1c4467dba sending to next pipeline
2026-03-27 22:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f00721fc-9b25-5ba4-868f-70e1c4467dba, identifier: 1987518
2026-03-27 22:50:37 [ayvens.be] INFO: Found listing with ID: 1986037
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986037%27 HTTP/1.1" 200 None
2026-03-27 22:50:37 [ayvens.be] INFO: Scrape type for 1986037: 2
2026-03-27 22:50:37 [ayvens.be] INFO: Extracting data for car ID: 1986037
2026-03-27 22:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-27 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 2
2026-03-27 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 2
2026-03-27 22:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c7d428a-e542-54a6-9d6b-4241d510c1db, identifier: 1986037
2026-03-27 22:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f00721fc-9b25-5ba4-868f-70e1c4467dba with identifier: 1987518
2026-03-27 22:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f00721fc-9b25-5ba4-868f-70e1c4467dba with identifier: 1987518
2026-03-27 22:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f00721fc-9b25-5ba4-868f-70e1c4467dba with identifier: 1987518 to the API
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f00721fc-9b25-5ba4-868f-70e1c4467dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 76204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00721fc-9b25-5ba4-868f-70e1c4467dba/f00721fc-9b25-5ba4-868f-70e1c4467dba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/a456e1d0dc80465cafa55bb994f43db8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987518%27 HTTP/1.1" 200 None
2026-03-27 22:50:37 [ayvens.be] INFO: Saving data for 1987518: {'created_time': 1774651837.70768, 'last_price_update_time': 1774651837.70769, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987518') HTTP/1.1" 204 0
2026-03-27 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-27 22:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-27 22:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037 to the API
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8c7d428a-e542-54a6-9d6b-4241d510c1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 97195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 518D 100KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 100KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986037%27 HTTP/1.1" 200 None
2026-03-27 22:50:37 [ayvens.be] INFO: Saving data for 1986037: {'auction_closing_time': 1775028600.0, 'created_time': 1774565146.082988, 'last_price_update_time': 1774651837.996365}
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986037') HTTP/1.1" 204 0
2026-03-27 22:50:38 [ayvens.be] INFO: Found listing with ID: 1986038
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986038%27 HTTP/1.1" 200 None
2026-03-27 22:50:38 [ayvens.be] INFO: Scrape type for 1986038: 2
2026-03-27 22:50:38 [ayvens.be] INFO: Extracting data for car ID: 1986038
2026-03-27 22:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-27 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 2
2026-03-27 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 2
2026-03-27 22:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a785095c-c896-5b3b-9fac-f87b2e173115, identifier: 1986038
2026-03-27 22:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-27 22:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-27 22:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038 to the API
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a785095c-c896-5b3b-9fac-f87b2e173115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 48154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986038%27 HTTP/1.1" 200 None
2026-03-27 22:50:38 [ayvens.be] INFO: Saving data for 1986038: {'auction_closing_time': 1775028600.0, 'created_time': 1774565147.428513, 'last_price_update_time': 1774651838.381051}
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986038') HTTP/1.1" 204 0
2026-03-27 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea2d50>
2026-03-27 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/1.jpg saved to cache
2026-03-27 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:38 [ayvens.be] INFO: Found listing with ID: 1986039
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986039%27 HTTP/1.1" 200 None
2026-03-27 22:50:38 [ayvens.be] INFO: Scrape type for 1986039: 2
2026-03-27 22:50:38 [ayvens.be] INFO: Extracting data for car ID: 1986039
2026-03-27 22:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-27 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 2
2026-03-27 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 2
2026-03-27 22:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, identifier: 1986039
2026-03-27 22:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-27 22:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-27 22:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039 to the API
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a8b13729-051a-5f0f-82ed-76c5c3e0e89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 50993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'vin': None,
 'year': 2023}
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986039%27 HTTP/1.1" 200 None
2026-03-27 22:50:38 [ayvens.be] INFO: Saving data for 1986039: {'auction_closing_time': 1775028600.0, 'created_time': 1774565148.890421, 'last_price_update_time': 1774651838.874568}
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986039') HTTP/1.1" 204 0
2026-03-27 22:50:38 [ayvens.be] INFO: Found listing with ID: 1986040
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986040%27 HTTP/1.1" 200 None
2026-03-27 22:50:38 [ayvens.be] INFO: Scrape type for 1986040: 2
2026-03-27 22:50:38 [ayvens.be] INFO: Extracting data for car ID: 1986040
2026-03-27 22:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-27 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 2
2026-03-27 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 2
2026-03-27 22:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7d88768-9bf6-5f29-90de-1b51ec377c95, identifier: 1986040
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4582390>
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/2.jpg saved to cache
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d59a5050>
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/4.jpg saved to cache
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-27 22:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-27 22:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040 to the API
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b7d88768-9bf6-5f29-90de-1b51ec377c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 77898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 71KWH 50 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH 50 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986040%27 HTTP/1.1" 200 None
2026-03-27 22:50:39 [ayvens.be] INFO: Saving data for 1986040: {'auction_closing_time': 1775028600.0, 'created_time': 1774565150.63926, 'last_price_update_time': 1774651839.435589}
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986040') HTTP/1.1" 204 0
2026-03-27 22:50:39 [ayvens.be] INFO: Found listing with ID: 1986041
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986041%27 HTTP/1.1" 200 None
2026-03-27 22:50:39 [ayvens.be] INFO: Scrape type for 1986041: 2
2026-03-27 22:50:39 [ayvens.be] INFO: Extracting data for car ID: 1986041
2026-03-27 22:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-27 22:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 2
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 2
2026-03-27 22:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 773e2031-4730-5eec-ada3-05f112376a35, identifier: 1986041
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52f6bd0>
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/8.jpg saved to cache
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d45b0290>
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/5.jpg saved to cache
2026-03-27 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-27 22:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-27 22:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041 to the API
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '773e2031-4730-5eec-ada3-05f112376a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 77912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986041%27 HTTP/1.1" 200 None
2026-03-27 22:50:39 [ayvens.be] INFO: Saving data for 1986041: {'auction_closing_time': 1775028600.0, 'created_time': 1774565152.544676, 'last_price_update_time': 1774651839.978936}
2026-03-27 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986041') HTTP/1.1" 204 0
2026-03-27 22:50:40 [ayvens.be] INFO: Found listing with ID: 1986042
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986042%27 HTTP/1.1" 200 None
2026-03-27 22:50:40 [ayvens.be] INFO: Scrape type for 1986042: 2
2026-03-27 22:50:40 [ayvens.be] INFO: Extracting data for car ID: 1986042
2026-03-27 22:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-27 22:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 2
2026-03-27 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 2
2026-03-27 22:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed, identifier: 1986042
2026-03-27 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-27 22:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-27 22:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042 to the API
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 100444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986042%27 HTTP/1.1" 200 None
2026-03-27 22:50:40 [ayvens.be] INFO: Saving data for 1986042: {'auction_closing_time': 1775028600.0, 'created_time': 1774565153.697382, 'last_price_update_time': 1774651840.463137}
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986042') HTTP/1.1" 204 0
2026-03-27 22:50:40 [ayvens.be] INFO: Found listing with ID: 1986043
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986043%27 HTTP/1.1" 200 None
2026-03-27 22:50:40 [ayvens.be] INFO: Scrape type for 1986043: 2
2026-03-27 22:50:40 [ayvens.be] INFO: Extracting data for car ID: 1986043
2026-03-27 22:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-27 22:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75d91fb-83ba-554c-931a-fd5238a3de47 with scrape type 2
2026-03-27 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a75d91fb-83ba-554c-931a-fd5238a3de47 with scrape type 2
2026-03-27 22:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a75d91fb-83ba-554c-931a-fd5238a3de47, identifier: 1986043
2026-03-27 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-27 22:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-27 22:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043 to the API
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a75d91fb-83ba-554c-931a-fd5238a3de47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'EX30',
 'odometer': 16659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO EX30 BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'vin': None,
 'year': 2024}
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986043%27 HTTP/1.1" 200 None
2026-03-27 22:50:40 [ayvens.be] INFO: Saving data for 1986043: {'auction_closing_time': 1775028600.0, 'created_time': 1774565155.759483, 'last_price_update_time': 1774651840.884531}
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986043') HTTP/1.1" 204 0
2026-03-27 22:50:40 [ayvens.be] INFO: Found listing with ID: 1986044
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986044%27 HTTP/1.1" 200 None
2026-03-27 22:50:40 [ayvens.be] INFO: Scrape type for 1986044: 2
2026-03-27 22:50:40 [ayvens.be] INFO: Extracting data for car ID: 1986044
2026-03-27 22:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-27 22:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d16ce74-aed5-5916-80bb-e5a1ac156184 with scrape type 2
2026-03-27 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d16ce74-aed5-5916-80bb-e5a1ac156184 with scrape type 2
2026-03-27 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d16ce74-aed5-5916-80bb-e5a1ac156184, identifier: 1986044
2026-03-27 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-27 22:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-27 22:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044 to the API
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d16ce74-aed5-5916-80bb-e5a1ac156184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 164594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.4 TSI PHEV 150KW DSG CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG CLEVER',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986044%27 HTTP/1.1" 200 None
2026-03-27 22:50:41 [ayvens.be] INFO: Saving data for 1986044: {'auction_closing_time': 1775028600.0, 'created_time': 1774565157.404658, 'last_price_update_time': 1774651841.327914}
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986044') HTTP/1.1" 204 0
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4566b10>
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/7.jpg saved to cache
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:41 [ayvens.be] INFO: Found listing with ID: 1986045
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986045%27 HTTP/1.1" 200 None
2026-03-27 22:50:41 [ayvens.be] INFO: Scrape type for 1986045: 2
2026-03-27 22:50:41 [ayvens.be] INFO: Extracting data for car ID: 1986045
2026-03-27 22:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-27 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d010e538-ecc5-5d8b-87d0-d392c7fd8842 with scrape type 2
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d010e538-ecc5-5d8b-87d0-d392c7fd8842 with scrape type 2
2026-03-27 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d010e538-ecc5-5d8b-87d0-d392c7fd8842, identifier: 1986045
2026-03-27 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-27 22:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-27 22:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045 to the API
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd010e538-ecc5-5d8b-87d0-d392c7fd8842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 35 FOURGON MWB HR DSL',
 'odometer': 114878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 FOURGON MWB HR DSL 2.0 CR TDi L3H3 '
          'Automatic-8 STOCK',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi L3H3 Automatic-8 STOCK',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986045%27 HTTP/1.1" 200 None
2026-03-27 22:50:41 [ayvens.be] INFO: Saving data for 1986045: {'auction_closing_time': 1775028600.0, 'created_time': 1774565159.237657, 'last_price_update_time': 1774651841.785459}
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986045') HTTP/1.1" 204 0
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d560f390>
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff70baf9b849347c1afbf06686c8f31cb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/6.jpg saved to cache
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31
2026-03-27 22:50:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b4d6b07-7dd1-5624-a383-50316d7e6b31, skipping ID generation
2026-03-27 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with scrape type 1
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b4d6b07-7dd1-5624-a383-50316d7e6b31 sending to next pipeline
2026-03-27 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b4d6b07-7dd1-5624-a383-50316d7e6b31, identifier: 1987528
2026-03-27 22:50:41 [ayvens.be] INFO: Found listing with ID: 1986046
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986046%27 HTTP/1.1" 200 None
2026-03-27 22:50:41 [ayvens.be] INFO: Scrape type for 1986046: 2
2026-03-27 22:50:41 [ayvens.be] INFO: Extracting data for car ID: 1986046
2026-03-27 22:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-27 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 2
2026-03-27 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 2
2026-03-27 22:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c32ddf75-f711-5d8e-88f4-e2a8637663cd, identifier: 1986046
2026-03-27 22:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with identifier: 1987528
2026-03-27 22:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with identifier: 1987528
2026-03-27 22:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b4d6b07-7dd1-5624-a383-50316d7e6b31 with identifier: 1987528 to the API
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '8b4d6b07-7dd1-5624-a383-50316d7e6b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 56557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4d6b07-7dd1-5624-a383-50316d7e6b31/8b4d6b07-7dd1-5624-a383-50316d7e6b31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f70baf9b849347c1afbf06686c8f31cb/images/large/7.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 1,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL 1 pl',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987528%27 HTTP/1.1" 200 None
2026-03-27 22:50:42 [ayvens.be] INFO: Saving data for 1987528: {'created_time': 1774651842.447339, 'last_price_update_time': 1774651842.447352, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987528') HTTP/1.1" 204 0
2026-03-27 22:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-27 22:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-27 22:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046 to the API
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c32ddf75-f711-5d8e-88f4-e2a8637663cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 144843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 170KW XDRIVE AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986046%27 HTTP/1.1" 200 None
2026-03-27 22:50:42 [ayvens.be] INFO: Saving data for 1986046: {'auction_closing_time': 1775028600.0, 'created_time': 1774565161.143158, 'last_price_update_time': 1774651842.731718}
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986046') HTTP/1.1" 204 0
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55b3d90>
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/7.jpg saved to cache
2026-03-27 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4553810>
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc7e92f391371463597344db80b1c1971%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/10.jpg saved to cache
2026-03-27 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8
2026-03-27 22:50:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8, skipping ID generation
2026-03-27 22:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with scrape type 1
2026-03-27 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 sending to next pipeline
2026-03-27 22:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8, identifier: 1987516
2026-03-27 22:50:42 [ayvens.be] INFO: Found listing with ID: 1986047
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986047%27 HTTP/1.1" 200 None
2026-03-27 22:50:43 [ayvens.be] INFO: Scrape type for 1986047: 2
2026-03-27 22:50:43 [ayvens.be] INFO: Extracting data for car ID: 1986047
2026-03-27 22:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-27 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 2
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 2
2026-03-27 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, identifier: 1986047
2026-03-27 22:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with identifier: 1987516
2026-03-27 22:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with identifier: 1987516
2026-03-27 22:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13a8d7a7-6a53-5d29-a6bf-41a275df3de8 with identifier: 1987516 to the API
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '13a8d7a7-6a53-5d29-a6bf-41a275df3de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 41971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a8d7a7-6a53-5d29-a6bf-41a275df3de8/13a8d7a7-6a53-5d29-a6bf-41a275df3de8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c7e92f391371463597344db80b1c1971/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987516%27 HTTP/1.1" 200 None
2026-03-27 22:50:43 [ayvens.be] INFO: Saving data for 1987516: {'created_time': 1774651843.440246, 'last_price_update_time': 1774651843.440256, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987516') HTTP/1.1" 204 0
2026-03-27 22:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-27 22:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-27 22:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047 to the API
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c35c4e19-ff8a-52ec-beab-c502dd7d84cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 95935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986047%27 HTTP/1.1" 200 None
2026-03-27 22:50:43 [ayvens.be] INFO: Saving data for 1986047: {'auction_closing_time': 1775028600.0, 'created_time': 1774565162.216637, 'last_price_update_time': 1774651843.710599}
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986047') HTTP/1.1" 204 0
2026-03-27 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:43 [ayvens.be] INFO: Found listing with ID: 1986048
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986048%27 HTTP/1.1" 200 None
2026-03-27 22:50:43 [ayvens.be] INFO: Scrape type for 1986048: 2
2026-03-27 22:50:43 [ayvens.be] INFO: Extracting data for car ID: 1986048
2026-03-27 22:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-27 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 2
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 2
2026-03-27 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1077883c-b0c1-5767-992f-d0213ab4e1c7, identifier: 1986048
2026-03-27 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56ad090>
2026-03-27 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6f3ec3ceb13a466298fde96c7f69ff94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/6.jpg saved to cache
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18ad8eda-4aa3-588c-a141-b800f400eb2c
2026-03-27 22:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18ad8eda-4aa3-588c-a141-b800f400eb2c, skipping ID generation
2026-03-27 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ad8eda-4aa3-588c-a141-b800f400eb2c with scrape type 1
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18ad8eda-4aa3-588c-a141-b800f400eb2c sending to next pipeline
2026-03-27 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18ad8eda-4aa3-588c-a141-b800f400eb2c, identifier: 1987527
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-27 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-27 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048 to the API
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1077883c-b0c1-5767-992f-d0213ab4e1c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 64116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986048%27 HTTP/1.1" 200 None
2026-03-27 22:50:44 [ayvens.be] INFO: Saving data for 1986048: {'auction_closing_time': 1775028600.0, 'created_time': 1774565164.968467, 'last_price_update_time': 1774651844.293343}
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986048') HTTP/1.1" 204 0
2026-03-27 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18ad8eda-4aa3-588c-a141-b800f400eb2c with identifier: 1987527
2026-03-27 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18ad8eda-4aa3-588c-a141-b800f400eb2c with identifier: 1987527
2026-03-27 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18ad8eda-4aa3-588c-a141-b800f400eb2c with identifier: 1987527 to the API
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '18ad8eda-4aa3-588c-a141-b800f400eb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 8964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ad8eda-4aa3-588c-a141-b800f400eb2c/18ad8eda-4aa3-588c-a141-b800f400eb2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6f3ec3ceb13a466298fde96c7f69ff94/images/large/8.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987527%27 HTTP/1.1" 200 None
2026-03-27 22:50:44 [ayvens.be] INFO: Saving data for 1987527: {'created_time': 1774651844.726754, 'last_price_update_time': 1774651844.726765, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987527') HTTP/1.1" 204 0
2026-03-27 22:50:44 [ayvens.be] INFO: Found listing with ID: 1986049
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986049%27 HTTP/1.1" 200 None
2026-03-27 22:50:44 [ayvens.be] INFO: Scrape type for 1986049: 2
2026-03-27 22:50:44 [ayvens.be] INFO: Extracting data for car ID: 1986049
2026-03-27 22:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-27 22:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 2
2026-03-27 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 2
2026-03-27 22:50:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, identifier: 1986049
2026-03-27 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-27 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-27 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049 to the API
2026-03-27 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '55de8cbe-2247-5b6f-b8d2-39ad91e6d17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 40253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986049%27 HTTP/1.1" 200 None
2026-03-27 22:50:45 [ayvens.be] INFO: Saving data for 1986049: {'auction_closing_time': 1775028600.0, 'created_time': 1774565166.295278, 'last_price_update_time': 1774651845.136278}
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986049') HTTP/1.1" 204 0
2026-03-27 22:50:45 [ayvens.be] INFO: Found listing with ID: 1986050
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986050%27 HTTP/1.1" 200 None
2026-03-27 22:50:45 [ayvens.be] INFO: Scrape type for 1986050: 2
2026-03-27 22:50:45 [ayvens.be] INFO: Extracting data for car ID: 1986050
2026-03-27 22:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-27 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 2
2026-03-27 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 2
2026-03-27 22:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00349aad-9198-5bb8-b310-8af076348f0e, identifier: 1986050
2026-03-27 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55ee590>
2026-03-27 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/8.jpg saved to cache
2026-03-27 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-27 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-27 22:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050 to the API
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '00349aad-9198-5bb8-b310-8af076348f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 85166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986050%27 HTTP/1.1" 200 None
2026-03-27 22:50:45 [ayvens.be] INFO: Saving data for 1986050: {'auction_closing_time': 1775028600.0, 'created_time': 1774565167.89063, 'last_price_update_time': 1774651845.625736}
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986050') HTTP/1.1" 204 0
2026-03-27 22:50:45 [ayvens.be] INFO: Found listing with ID: 1986051
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986051%27 HTTP/1.1" 200 None
2026-03-27 22:50:45 [ayvens.be] INFO: Scrape type for 1986051: 2
2026-03-27 22:50:45 [ayvens.be] INFO: Extracting data for car ID: 1986051
2026-03-27 22:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-27 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 2
2026-03-27 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 2
2026-03-27 22:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 735aded9-be81-558c-a6a9-efc2b66de218, identifier: 1986051
2026-03-27 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-27 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-27 22:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051 to the API
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '735aded9-be81-558c-a6a9-efc2b66de218',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 128479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 250 E BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 B 250 E BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986051%27 HTTP/1.1" 200 None
2026-03-27 22:50:46 [ayvens.be] INFO: Saving data for 1986051: {'auction_closing_time': 1775028600.0, 'created_time': 1774565169.953661, 'last_price_update_time': 1774651846.032604}
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986051') HTTP/1.1" 204 0
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5395d10>
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/2.jpg saved to cache
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:46 [ayvens.be] INFO: Found listing with ID: 1986052
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986052%27 HTTP/1.1" 200 None
2026-03-27 22:50:46 [ayvens.be] INFO: Scrape type for 1986052: 2
2026-03-27 22:50:46 [ayvens.be] INFO: Extracting data for car ID: 1986052
2026-03-27 22:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-27 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 2
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 2
2026-03-27 22:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 25d49266-b07d-5698-9e45-925e342cd487, identifier: 1986052
2026-03-27 22:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-27 22:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-27 22:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052 to the API
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '25d49266-b07d-5698-9e45-925e342cd487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 152141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986052%27 HTTP/1.1" 200 None
2026-03-27 22:50:46 [ayvens.be] INFO: Saving data for 1986052: {'auction_closing_time': 1775028600.0, 'created_time': 1774565171.17679, 'last_price_update_time': 1774651846.519095}
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986052') HTTP/1.1" 204 0
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52bfa50>
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ws%252Fdd394f9864194eee98c2f48013606569%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/10.jpg saved to cache
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87
2026-03-27 22:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3d68db2-6c20-5775-bad4-ae3f2ab77b87, skipping ID generation
2026-03-27 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with scrape type 1
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3d68db2-6c20-5775-bad4-ae3f2ab77b87 sending to next pipeline
2026-03-27 22:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c3d68db2-6c20-5775-bad4-ae3f2ab77b87, identifier: 1987514
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d458cd50>
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff7bb7f54c93c487cb8a42a9f53064f7c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/1.jpg saved to cache
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dac59bce-46a7-5911-ae8b-3bad79b745cf
2026-03-27 22:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dac59bce-46a7-5911-ae8b-3bad79b745cf, skipping ID generation
2026-03-27 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac59bce-46a7-5911-ae8b-3bad79b745cf with scrape type 1
2026-03-27 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dac59bce-46a7-5911-ae8b-3bad79b745cf sending to next pipeline
2026-03-27 22:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dac59bce-46a7-5911-ae8b-3bad79b745cf, identifier: 1987515
2026-03-27 22:50:47 [ayvens.be] INFO: Found listing with ID: 1986053
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986053%27 HTTP/1.1" 200 None
2026-03-27 22:50:47 [ayvens.be] INFO: Scrape type for 1986053: 2
2026-03-27 22:50:47 [ayvens.be] INFO: Extracting data for car ID: 1986053
2026-03-27 22:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-27 22:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 2
2026-03-27 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 2
2026-03-27 22:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 903e1390-8721-55ae-9697-cc1db8002744, identifier: 1986053
2026-03-27 22:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with identifier: 1987514
2026-03-27 22:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with identifier: 1987514
2026-03-27 22:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c3d68db2-6c20-5775-bad4-ae3f2ab77b87 with identifier: 1987514 to the API
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3d68db2-6c20-5775-bad4-ae3f2ab77b87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 55725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d68db2-6c20-5775-bad4-ae3f2ab77b87/c3d68db2-6c20-5775-bad4-ae3f2ab77b87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ws/dd394f9864194eee98c2f48013606569/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort (EU6)',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort (EU6)',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987514%27 HTTP/1.1" 200 None
2026-03-27 22:50:47 [ayvens.be] INFO: Saving data for 1987514: {'created_time': 1774651847.472822, 'last_price_update_time': 1774651847.472844, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987514') HTTP/1.1" 204 0
2026-03-27 22:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dac59bce-46a7-5911-ae8b-3bad79b745cf with identifier: 1987515
2026-03-27 22:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dac59bce-46a7-5911-ae8b-3bad79b745cf with identifier: 1987515
2026-03-27 22:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dac59bce-46a7-5911-ae8b-3bad79b745cf with identifier: 1987515 to the API
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dac59bce-46a7-5911-ae8b-3bad79b745cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 47625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac59bce-46a7-5911-ae8b-3bad79b745cf/dac59bce-46a7-5911-ae8b-3bad79b745cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f7bb7f54c93c487cb8a42a9f53064f7c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987515%27 HTTP/1.1" 200 None
2026-03-27 22:50:47 [ayvens.be] INFO: Saving data for 1987515: {'created_time': 1774651847.952169, 'last_price_update_time': 1774651847.952181, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987515') HTTP/1.1" 204 0
2026-03-27 22:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-27 22:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-27 22:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053 to the API
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '903e1390-8721-55ae-9697-cc1db8002744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 86016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986053%27 HTTP/1.1" 200 None
2026-03-27 22:50:48 [ayvens.be] INFO: Saving data for 1986053: {'auction_closing_time': 1775028600.0, 'created_time': 1774565172.41042, 'last_price_update_time': 1774651848.231688}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986053') HTTP/1.1" 204 0
2026-03-27 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5551d10>
2026-03-27 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F574ebd29af9d4822901b848b221c0eb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/5.jpg saved to cache
2026-03-27 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf
2026-03-27 22:50:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1987513
2026-03-27 22:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1987513
2026-03-27 22:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1987513 to the API
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:48 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cbd8a953-b9cd-57bc-92b4-d1e5046c16bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 54292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbd8a953-b9cd-57bc-92b4-d1e5046c16bf/cbd8a953-b9cd-57bc-92b4-d1e5046c16bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/574ebd29af9d4822901b848b221c0eb6/images/large/8.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987513%27 HTTP/1.1" 200 None
2026-03-27 22:50:48 [ayvens.be] INFO: Saving data for 1987513: {'created_time': 1774651848.610641, 'last_price_update_time': 1774651848.610652, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987513') HTTP/1.1" 204 0
2026-03-27 22:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0867f8e-3048-5bb8-a9bb-3678e560940f with identifier: 1987512
2026-03-27 22:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0867f8e-3048-5bb8-a9bb-3678e560940f with identifier: 1987512
2026-03-27 22:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0867f8e-3048-5bb8-a9bb-3678e560940f with identifier: 1987512 to the API
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:48 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0867f8e-3048-5bb8-a9bb-3678e560940f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 64115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0867f8e-3048-5bb8-a9bb-3678e560940f/c0867f8e-3048-5bb8-a9bb-3678e560940f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/287911d1cf994de2b8271f77cd24beec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987512%27 HTTP/1.1" 200 None
2026-03-27 22:50:48 [ayvens.be] INFO: Saving data for 1987512: {'created_time': 1774651848.958532, 'last_price_update_time': 1774651848.958542, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987512') HTTP/1.1" 204 0
2026-03-27 22:50:48 [ayvens.be] INFO: Found listing with ID: 1986054
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986054%27 HTTP/1.1" 200 None
2026-03-27 22:50:48 [ayvens.be] INFO: Scrape type for 1986054: 2
2026-03-27 22:50:48 [ayvens.be] INFO: Extracting data for car ID: 1986054
2026-03-27 22:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-27 22:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30e219f-3220-5b64-b86f-01bce4968bbe with scrape type 2
2026-03-27 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30e219f-3220-5b64-b86f-01bce4968bbe with scrape type 2
2026-03-27 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f30e219f-3220-5b64-b86f-01bce4968bbe, identifier: 1986054
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c0867f8e-3048-5bb8-a9bb-3678e560940f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-27 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-27 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054 to the API
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f30e219f-3220-5b64-b86f-01bce4968bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 130758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986054%27 HTTP/1.1" 200 None
2026-03-27 22:50:49 [ayvens.be] INFO: Saving data for 1986054: {'auction_closing_time': 1775028600.0, 'created_time': 1774565174.981118, 'last_price_update_time': 1774651849.354645}
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986054') HTTP/1.1" 204 0
2026-03-27 22:50:49 [ayvens.be] INFO: Found listing with ID: 1986055
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986055%27 HTTP/1.1" 200 None
2026-03-27 22:50:49 [ayvens.be] INFO: Scrape type for 1986055: 2
2026-03-27 22:50:49 [ayvens.be] INFO: Extracting data for car ID: 1986055
2026-03-27 22:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-27 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with scrape type 2
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with scrape type 2
2026-03-27 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9141ae3d-f426-5d7e-8314-c2bb045d46a8, identifier: 1986055
2026-03-27 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-27 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-27 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055 to the API
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9141ae3d-f426-5d7e-8314-c2bb045d46a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 49990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 DIG-T 140 EVAPO N-CONNECTA',
 'transmission': 'manual',
 'trim': '1.3 DIG-T 140 EVAPO N-CONNECTA',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986055%27 HTTP/1.1" 200 None
2026-03-27 22:50:49 [ayvens.be] INFO: Saving data for 1986055: {'auction_closing_time': 1775028600.0, 'created_time': 1774565176.630935, 'last_price_update_time': 1774651849.765702}
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986055') HTTP/1.1" 204 0
2026-03-27 22:50:49 [ayvens.be] INFO: Found listing with ID: 1986056
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986056%27 HTTP/1.1" 200 None
2026-03-27 22:50:49 [ayvens.be] INFO: Scrape type for 1986056: 2
2026-03-27 22:50:49 [ayvens.be] INFO: Extracting data for car ID: 1986056
2026-03-27 22:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-27 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f3edeb-a72e-5665-83c2-ec33099e72e1 with scrape type 2
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f3edeb-a72e-5665-83c2-ec33099e72e1 with scrape type 2
2026-03-27 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95f3edeb-a72e-5665-83c2-ec33099e72e1, identifier: 1986056
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8cae3708-f033-58bd-afa3-817ac4b612d3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8cae3708-f033-58bd-afa3-817ac4b612d3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8cae3708-f033-58bd-afa3-817ac4b612d3 with identifier: 1987509
2026-03-27 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8cae3708-f033-58bd-afa3-817ac4b612d3 with identifier: 1987509
2026-03-27 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8cae3708-f033-58bd-afa3-817ac4b612d3 with identifier: 1987509 to the API
2026-03-27 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '8cae3708-f033-58bd-afa3-817ac4b612d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 76116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cae3708-f033-58bd-afa3-817ac4b612d3/8cae3708-f033-58bd-afa3-817ac4b612d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/8d40c6d480b84ea681c9dd2c37d0447f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987509%27 HTTP/1.1" 200 None
2026-03-27 22:50:50 [ayvens.be] INFO: Saving data for 1987509: {'created_time': 1774651850.215457, 'last_price_update_time': 1774651850.215467, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987509') HTTP/1.1" 204 0
2026-03-27 22:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-27 22:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-27 22:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056 to the API
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '95f3edeb-a72e-5665-83c2-ec33099e72e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 79699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986056%27 HTTP/1.1" 200 None
2026-03-27 22:50:50 [ayvens.be] INFO: Saving data for 1986056: {'auction_closing_time': 1775028600.0, 'created_time': 1774565178.080415, 'last_price_update_time': 1774651850.500743}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986056') HTTP/1.1" 204 0
2026-03-27 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8cae3708-f033-58bd-afa3-817ac4b612d3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:50 [ayvens.be] INFO: Found listing with ID: 1986057
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986057%27 HTTP/1.1" 200 None
2026-03-27 22:50:50 [ayvens.be] INFO: Scrape type for 1986057: 2
2026-03-27 22:50:50 [ayvens.be] INFO: Extracting data for car ID: 1986057
2026-03-27 22:50:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-27 22:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b349ff55-7466-590b-bffd-73237a1ae400 with scrape type 2
2026-03-27 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b349ff55-7466-590b-bffd-73237a1ae400 with scrape type 2
2026-03-27 22:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b349ff55-7466-590b-bffd-73237a1ae400, identifier: 1986057
2026-03-27 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d90210>
2026-03-27 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/9.jpg saved to cache
2026-03-27 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-27 22:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-27 22:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057 to the API
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b349ff55-7466-590b-bffd-73237a1ae400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 108100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986057%27 HTTP/1.1" 200 None
2026-03-27 22:50:50 [ayvens.be] INFO: Saving data for 1986057: {'auction_closing_time': 1775028600.0, 'created_time': 1774565179.857056, 'last_price_update_time': 1774651850.974967}
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986057') HTTP/1.1" 204 0
2026-03-27 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:50 [ayvens.be] INFO: Found listing with ID: 1986058
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986058%27 HTTP/1.1" 200 None
2026-03-27 22:50:51 [ayvens.be] INFO: Scrape type for 1986058: 2
2026-03-27 22:50:51 [ayvens.be] INFO: Extracting data for car ID: 1986058
2026-03-27 22:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-27 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03492f-3c74-5a66-9455-28bf6cc089f5 with scrape type 2
2026-03-27 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a03492f-3c74-5a66-9455-28bf6cc089f5 with scrape type 2
2026-03-27 22:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a03492f-3c74-5a66-9455-28bf6cc089f5, identifier: 1986058
2026-03-27 22:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-27 22:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-27 22:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058 to the API
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '9a03492f-3c74-5a66-9455-28bf6cc089f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 53759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986058%27 HTTP/1.1" 200 None
2026-03-27 22:50:51 [ayvens.be] INFO: Saving data for 1986058: {'auction_closing_time': 1775028600.0, 'created_time': 1774565181.371903, 'last_price_update_time': 1774651851.352768}
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986058') HTTP/1.1" 204 0
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d530f650>
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/7.jpg saved to cache
2026-03-27 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:51 [ayvens.be] INFO: Found listing with ID: 1986059
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986059%27 HTTP/1.1" 200 None
2026-03-27 22:50:51 [ayvens.be] INFO: Scrape type for 1986059: 2
2026-03-27 22:50:51 [ayvens.be] INFO: Extracting data for car ID: 1986059
2026-03-27 22:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-27 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a197201-09a4-5914-9db7-b1acd397848f with scrape type 2
2026-03-27 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a197201-09a4-5914-9db7-b1acd397848f with scrape type 2
2026-03-27 22:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6a197201-09a4-5914-9db7-b1acd397848f, identifier: 1986059
2026-03-27 22:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-27 22:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-27 22:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059 to the API
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6a197201-09a4-5914-9db7-b1acd397848f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 107928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 SDRIVE18D (100KW)',
 'transmission': 'manual',
 'trim': '2.0 SDRIVE18D (100KW)',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986059%27 HTTP/1.1" 200 None
2026-03-27 22:50:51 [ayvens.be] INFO: Saving data for 1986059: {'auction_closing_time': 1775028600.0, 'created_time': 1774565183.88021, 'last_price_update_time': 1774651851.897653}
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986059') HTTP/1.1" 204 0
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5630550>
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/6.jpg saved to cache
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d531f150>
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/5.jpg saved to cache
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d454a010>
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F337df1fff3164b2b84dde58f3b8499f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/8.jpg saved to cache
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8189d5b-2c34-56f3-8f57-11cdea2120bc
2026-03-27 22:50:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8189d5b-2c34-56f3-8f57-11cdea2120bc, skipping ID generation
2026-03-27 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8189d5b-2c34-56f3-8f57-11cdea2120bc with scrape type 1
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8189d5b-2c34-56f3-8f57-11cdea2120bc sending to next pipeline
2026-03-27 22:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8189d5b-2c34-56f3-8f57-11cdea2120bc, identifier: 1987511
2026-03-27 22:50:52 [ayvens.be] INFO: Found listing with ID: 1986060
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986060%27 HTTP/1.1" 200 None
2026-03-27 22:50:52 [ayvens.be] INFO: Scrape type for 1986060: 2
2026-03-27 22:50:52 [ayvens.be] INFO: Extracting data for car ID: 1986060
2026-03-27 22:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-27 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with scrape type 2
2026-03-27 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with scrape type 2
2026-03-27 22:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935, identifier: 1986060
2026-03-27 22:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8189d5b-2c34-56f3-8f57-11cdea2120bc with identifier: 1987511
2026-03-27 22:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8189d5b-2c34-56f3-8f57-11cdea2120bc with identifier: 1987511
2026-03-27 22:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8189d5b-2c34-56f3-8f57-11cdea2120bc with identifier: 1987511 to the API
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b8189d5b-2c34-56f3-8f57-11cdea2120bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 88373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8189d5b-2c34-56f3-8f57-11cdea2120bc/b8189d5b-2c34-56f3-8f57-11cdea2120bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/337df1fff3164b2b84dde58f3b8499f9/images/large/9.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987511%27 HTTP/1.1" 200 None
2026-03-27 22:50:52 [ayvens.be] INFO: Saving data for 1987511: {'created_time': 1774651852.704717, 'last_price_update_time': 1774651852.704728, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987511') HTTP/1.1" 204 0
2026-03-27 22:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-27 22:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-27 22:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060 to the API
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a3e5ac1e-7a7e-554b-b75c-63b3f5a59935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 57131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986060%27 HTTP/1.1" 200 None
2026-03-27 22:50:52 [ayvens.be] INFO: Saving data for 1986060: {'auction_closing_time': 1775028600.0, 'created_time': 1774565184.276873, 'last_price_update_time': 1774651852.996256}
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986060') HTTP/1.1" 204 0
2026-03-27 22:50:53 [ayvens.be] INFO: Found listing with ID: 1986061
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986061%27 HTTP/1.1" 200 None
2026-03-27 22:50:53 [ayvens.be] INFO: Scrape type for 1986061: 2
2026-03-27 22:50:53 [ayvens.be] INFO: Extracting data for car ID: 1986061
2026-03-27 22:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-27 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with scrape type 2
2026-03-27 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with scrape type 2
2026-03-27 22:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee42f577-0ba2-553b-8bfb-a6c2fba8c938, identifier: 1986061
2026-03-27 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 77cf9383-4509-5ac2-8a85-25d719a46c10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 77cf9383-4509-5ac2-8a85-25d719a46c10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 77cf9383-4509-5ac2-8a85-25d719a46c10 with identifier: 1987507
2026-03-27 22:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 77cf9383-4509-5ac2-8a85-25d719a46c10 with identifier: 1987507
2026-03-27 22:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 77cf9383-4509-5ac2-8a85-25d719a46c10 with identifier: 1987507 to the API
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:53 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '77cf9383-4509-5ac2-8a85-25d719a46c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 150855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cf9383-4509-5ac2-8a85-25d719a46c10/77cf9383-4509-5ac2-8a85-25d719a46c10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/a040390f5397487985eb1e6fc1721abb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987507%27 HTTP/1.1" 200 None
2026-03-27 22:50:53 [ayvens.be] INFO: Saving data for 1987507: {'created_time': 1774651853.474707, 'last_price_update_time': 1774651853.474717, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987507') HTTP/1.1" 204 0
2026-03-27 22:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-27 22:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-27 22:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061 to the API
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ee42f577-0ba2-553b-8bfb-a6c2fba8c938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 79298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 E-TSI 81KW LIFE DSG',
 'transmission': 'automatic',
 'trim': '1.0 E-TSI 81KW LIFE DSG',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986061%27 HTTP/1.1" 200 None
2026-03-27 22:50:53 [ayvens.be] INFO: Saving data for 1986061: {'auction_closing_time': 1775028600.0, 'created_time': 1774565186.736512, 'last_price_update_time': 1774651853.753957}
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986061') HTTP/1.1" 204 0
2026-03-27 22:50:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 77cf9383-4509-5ac2-8a85-25d719a46c10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:53 [ayvens.be] INFO: Found listing with ID: 1986062
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986062%27 HTTP/1.1" 200 None
2026-03-27 22:50:53 [ayvens.be] INFO: Scrape type for 1986062: 2
2026-03-27 22:50:53 [ayvens.be] INFO: Extracting data for car ID: 1986062
2026-03-27 22:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-27 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bce15d-0997-5ef0-a16b-be412ce756f4 with scrape type 2
2026-03-27 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8bce15d-0997-5ef0-a16b-be412ce756f4 with scrape type 2
2026-03-27 22:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8bce15d-0997-5ef0-a16b-be412ce756f4, identifier: 1986062
2026-03-27 22:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-27 22:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-27 22:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062 to the API
2026-03-27 22:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bce15d-0997-5ef0-a16b-be412ce756f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2017',
 'odometer': 110608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2017 2.8 D-4D BM Transfo Van '
          'Fluxys',
 'transmission': 'manual',
 'trim': '2.8 D-4D BM Transfo Van Fluxys',
 'vin': None,
 'year': 2019}
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986062%27 HTTP/1.1" 200 None
2026-03-27 22:50:54 [ayvens.be] INFO: Saving data for 1986062: {'auction_closing_time': 1775028600.0, 'created_time': 1774565188.143502, 'last_price_update_time': 1774651854.137074}
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986062') HTTP/1.1" 204 0
2026-03-27 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:54 [ayvens.be] INFO: Found listing with ID: 1986063
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986063%27 HTTP/1.1" 200 None
2026-03-27 22:50:54 [ayvens.be] INFO: Scrape type for 1986063: 2
2026-03-27 22:50:54 [ayvens.be] INFO: Extracting data for car ID: 1986063
2026-03-27 22:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-27 22:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54368680-60a6-5d28-a06b-cee42607ebff with scrape type 2
2026-03-27 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54368680-60a6-5d28-a06b-cee42607ebff with scrape type 2
2026-03-27 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54368680-60a6-5d28-a06b-cee42607ebff, identifier: 1986063
2026-03-27 22:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-27 22:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-27 22:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063 to the API
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '54368680-60a6-5d28-a06b-cee42607ebff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 122169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986063%27 HTTP/1.1" 200 None
2026-03-27 22:50:54 [ayvens.be] INFO: Saving data for 1986063: {'auction_closing_time': 1775028600.0, 'created_time': 1774565189.893553, 'last_price_update_time': 1774651854.522443}
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986063') HTTP/1.1" 204 0
2026-03-27 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d753dcd0>
2026-03-27 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F84d6095b3e3443dfbe971ec264d3a609%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/10.jpg saved to cache
2026-03-27 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bceadae5-c486-5a22-ba10-2efcc4383af9
2026-03-27 22:50:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bceadae5-c486-5a22-ba10-2efcc4383af9, skipping ID generation
2026-03-27 22:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceadae5-c486-5a22-ba10-2efcc4383af9 with scrape type 1
2026-03-27 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bceadae5-c486-5a22-ba10-2efcc4383af9 sending to next pipeline
2026-03-27 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bceadae5-c486-5a22-ba10-2efcc4383af9, identifier: 1987508
2026-03-27 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:54 [ayvens.be] INFO: Found listing with ID: 1986064
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986064%27 HTTP/1.1" 200 None
2026-03-27 22:50:54 [ayvens.be] INFO: Scrape type for 1986064: 2
2026-03-27 22:50:54 [ayvens.be] INFO: Extracting data for car ID: 1986064
2026-03-27 22:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-27 22:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with scrape type 2
2026-03-27 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with scrape type 2
2026-03-27 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330, identifier: 1986064
2026-03-27 22:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bceadae5-c486-5a22-ba10-2efcc4383af9 with identifier: 1987508
2026-03-27 22:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bceadae5-c486-5a22-ba10-2efcc4383af9 with identifier: 1987508
2026-03-27 22:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bceadae5-c486-5a22-ba10-2efcc4383af9 with identifier: 1987508 to the API
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bceadae5-c486-5a22-ba10-2efcc4383af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 97810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceadae5-c486-5a22-ba10-2efcc4383af9/bceadae5-c486-5a22-ba10-2efcc4383af9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/84d6095b3e3443dfbe971ec264d3a609/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987508%27 HTTP/1.1" 200 None
2026-03-27 22:50:55 [ayvens.be] INFO: Saving data for 1987508: {'created_time': 1774651855.326584, 'last_price_update_time': 1774651855.326594, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987508') HTTP/1.1" 204 0
2026-03-27 22:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-27 22:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-27 22:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064 to the API
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9e70a0a4-0868-5521-9cb0-c4cc8d73a330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 174588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986064%27 HTTP/1.1" 200 None
2026-03-27 22:50:55 [ayvens.be] INFO: Saving data for 1986064: {'auction_closing_time': 1775028600.0, 'created_time': 1774565191.567381, 'last_price_update_time': 1774651855.609092}
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986064') HTTP/1.1" 204 0
2026-03-27 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4ea0750>
2026-03-27 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/7.jpg saved to cache
2026-03-27 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:55 [ayvens.be] INFO: Found listing with ID: 1986065
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986065%27 HTTP/1.1" 200 None
2026-03-27 22:50:55 [ayvens.be] INFO: Scrape type for 1986065: 2
2026-03-27 22:50:55 [ayvens.be] INFO: Extracting data for car ID: 1986065
2026-03-27 22:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-27 22:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with scrape type 2
2026-03-27 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with scrape type 2
2026-03-27 22:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94, identifier: 1986065
2026-03-27 22:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-27 22:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-27 22:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065 to the API
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 X',
 'odometer': 50757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 X 1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986065%27 HTTP/1.1" 200 None
2026-03-27 22:50:56 [ayvens.be] INFO: Saving data for 1986065: {'auction_closing_time': 1775028600.0, 'created_time': 1774565193.142312, 'last_price_update_time': 1774651856.081897}
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986065') HTTP/1.1" 204 0
2026-03-27 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5461210>
2026-03-27 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbabea0d784064ad2ae1ccef8e707a2ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/6.jpg saved to cache
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3072301-4ae2-5e7a-8eca-b224f85fe29d
2026-03-27 22:50:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3072301-4ae2-5e7a-8eca-b224f85fe29d, skipping ID generation
2026-03-27 22:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3072301-4ae2-5e7a-8eca-b224f85fe29d with scrape type 1
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3072301-4ae2-5e7a-8eca-b224f85fe29d sending to next pipeline
2026-03-27 22:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c3072301-4ae2-5e7a-8eca-b224f85fe29d, identifier: 1987505
2026-03-27 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item df194f46-03ee-511b-8f6d-26db91293ede due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:50:56 [ayvens.be] INFO: Found listing with ID: 1986066
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986066%27 HTTP/1.1" 200 None
2026-03-27 22:50:56 [ayvens.be] INFO: Scrape type for 1986066: 2
2026-03-27 22:50:56 [ayvens.be] INFO: Extracting data for car ID: 1986066
2026-03-27 22:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-27 22:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62b895f-d287-5f27-989b-d256b02cf905 with scrape type 2
2026-03-27 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d62b895f-d287-5f27-989b-d256b02cf905 with scrape type 2
2026-03-27 22:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d62b895f-d287-5f27-989b-d256b02cf905, identifier: 1986066
2026-03-27 22:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c3072301-4ae2-5e7a-8eca-b224f85fe29d with identifier: 1987505
2026-03-27 22:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c3072301-4ae2-5e7a-8eca-b224f85fe29d with identifier: 1987505
2026-03-27 22:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c3072301-4ae2-5e7a-8eca-b224f85fe29d with identifier: 1987505 to the API
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3072301-4ae2-5e7a-8eca-b224f85fe29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 43667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3072301-4ae2-5e7a-8eca-b224f85fe29d/c3072301-4ae2-5e7a-8eca-b224f85fe29d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/babea0d784064ad2ae1ccef8e707a2ca/images/large/8.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987505%27 HTTP/1.1" 200 None
2026-03-27 22:50:56 [ayvens.be] INFO: Saving data for 1987505: {'created_time': 1774651856.860037, 'last_price_update_time': 1774651856.860047, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987505') HTTP/1.1" 204 0
2026-03-27 22:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-27 22:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-27 22:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066 to the API
2026-03-27 22:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd62b895f-d287-5f27-989b-d256b02cf905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'ENYAQ',
 'odometer': 68699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA ENYAQ 82KWH IV 80',
 'transmission': 'automatic',
 'trim': '82KWH IV 80',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986066%27 HTTP/1.1" 200 None
2026-03-27 22:50:57 [ayvens.be] INFO: Saving data for 1986066: {'auction_closing_time': 1775028600.0, 'created_time': 1774565195.005, 'last_price_update_time': 1774651857.15435}
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986066') HTTP/1.1" 204 0
2026-03-27 22:50:57 [ayvens.be] INFO: Found listing with ID: 1986067
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986067%27 HTTP/1.1" 200 None
2026-03-27 22:50:57 [ayvens.be] INFO: Scrape type for 1986067: 2
2026-03-27 22:50:57 [ayvens.be] INFO: Extracting data for car ID: 1986067
2026-03-27 22:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-27 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with scrape type 2
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with scrape type 2
2026-03-27 22:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8, identifier: 1986067
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5395910>
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/10.jpg saved to cache
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df194f46-03ee-511b-8f6d-26db91293ede
2026-03-27 22:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-27 22:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-27 22:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067 to the API
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 28964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986067%27 HTTP/1.1" 200 None
2026-03-27 22:50:57 [ayvens.be] INFO: Saving data for 1986067: {'auction_closing_time': 1775028600.0, 'created_time': 1774565197.022482, 'last_price_update_time': 1774651857.667521}
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986067') HTTP/1.1" 204 0
2026-03-27 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:57 [ayvens.be] INFO: Found listing with ID: 1986068
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986068%27 HTTP/1.1" 200 None
2026-03-27 22:50:57 [ayvens.be] INFO: Scrape type for 1986068: 2
2026-03-27 22:50:57 [ayvens.be] INFO: Extracting data for car ID: 1986068
2026-03-27 22:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-27 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b9527f-99d2-56a6-90da-0ff54160ff73 with scrape type 2
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b9527f-99d2-56a6-90da-0ff54160ff73 with scrape type 2
2026-03-27 22:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f6b9527f-99d2-56a6-90da-0ff54160ff73, identifier: 1986068
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5395750>
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fe45409daf47449df8a930a564080a051%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/9.jpg saved to cache
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df194f46-03ee-511b-8f6d-26db91293ede
2026-03-27 22:50:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df194f46-03ee-511b-8f6d-26db91293ede, skipping ID generation
2026-03-27 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df194f46-03ee-511b-8f6d-26db91293ede with scrape type 1
2026-03-27 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df194f46-03ee-511b-8f6d-26db91293ede sending to next pipeline
2026-03-27 22:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df194f46-03ee-511b-8f6d-26db91293ede, identifier: 1987504
2026-03-27 22:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-27 22:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-27 22:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068 to the API
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f6b9527f-99d2-56a6-90da-0ff54160ff73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 80233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986068%27 HTTP/1.1" 200 None
2026-03-27 22:50:58 [ayvens.be] INFO: Saving data for 1986068: {'auction_closing_time': 1775028600.0, 'created_time': 1774565198.199446, 'last_price_update_time': 1774651858.873717}
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986068') HTTP/1.1" 204 0
2026-03-27 22:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df194f46-03ee-511b-8f6d-26db91293ede with identifier: 1987504
2026-03-27 22:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df194f46-03ee-511b-8f6d-26db91293ede with identifier: 1987504
2026-03-27 22:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df194f46-03ee-511b-8f6d-26db91293ede with identifier: 1987504 to the API
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'df194f46-03ee-511b-8f6d-26db91293ede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 38564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df194f46-03ee-511b-8f6d-26db91293ede/df194f46-03ee-511b-8f6d-26db91293ede_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/e45409daf47449df8a930a564080a051/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 1,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'vin': None,
 'year': 2021}
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987504%27 HTTP/1.1" 200 None
2026-03-27 22:50:59 [ayvens.be] INFO: Saving data for 1987504: {'created_time': 1774651859.268865, 'last_price_update_time': 1774651859.268878, 'auction_closing_time': 1775037600.0}
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987504') HTTP/1.1" 204 0
2026-03-27 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:59 [ayvens.be] INFO: Found listing with ID: 1986069
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986069%27 HTTP/1.1" 200 None
2026-03-27 22:50:59 [ayvens.be] INFO: Scrape type for 1986069: 2
2026-03-27 22:50:59 [ayvens.be] INFO: Extracting data for car ID: 1986069
2026-03-27 22:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-27 22:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with scrape type 2
2026-03-27 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with scrape type 2
2026-03-27 22:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7, identifier: 1986069
2026-03-27 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-27 22:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-27 22:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069 to the API
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '13f3b5cb-b2b3-534a-be68-e343ad7b86e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER',
 'vin': None,
 'year': 2022}
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986069%27 HTTP/1.1" 200 None
2026-03-27 22:50:59 [ayvens.be] INFO: Saving data for 1986069: {'auction_closing_time': 1775028600.0, 'created_time': 1774565199.314804, 'last_price_update_time': 1774651859.657649}
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986069') HTTP/1.1" 204 0
2026-03-27 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d55984d0>
2026-03-27 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/10.jpg saved to cache
2026-03-27 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e766d7c7-5ddf-5382-bdb5-fa309286f765 with identifier: 1987502
2026-03-27 22:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e766d7c7-5ddf-5382-bdb5-fa309286f765 with identifier: 1987502
2026-03-27 22:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e766d7c7-5ddf-5382-bdb5-fa309286f765 with identifier: 1987502 to the API
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e766d7c7-5ddf-5382-bdb5-fa309286f765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 73069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e766d7c7-5ddf-5382-bdb5-fa309286f765/e766d7c7-5ddf-5382-bdb5-fa309286f765_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c539835abacb48c08fd423396c71b2d5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987502%27 HTTP/1.1" 200 None
2026-03-27 22:51:00 [ayvens.be] INFO: Saving data for 1987502: {'created_time': 1774651860.131038, 'last_price_update_time': 1774651860.13105, 'auction_closing_time': 1775037600.0}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987502') HTTP/1.1" 204 0
2026-03-27 22:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 64bdbd79-5fbe-5826-8e9f-888196c49dee with identifier: 1987766
2026-03-27 22:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 64bdbd79-5fbe-5826-8e9f-888196c49dee with identifier: 1987766
2026-03-27 22:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 64bdbd79-5fbe-5826-8e9f-888196c49dee with identifier: 1987766 to the API
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '64bdbd79-5fbe-5826-8e9f-888196c49dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR',
 'odometer': 60373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64bdbd79-5fbe-5826-8e9f-888196c49dee/64bdbd79-5fbe-5826-8e9f-888196c49dee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/6a073065850044b792dbdb988c50237b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR 1.3 TCE 140 TECHNO',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 TECHNO',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987766%27 HTTP/1.1" 200 None
2026-03-27 22:51:00 [ayvens.be] INFO: Saving data for 1987766: {'created_time': 1774651860.55275, 'last_price_update_time': 1774651860.55276, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987766') HTTP/1.1" 204 0
2026-03-27 22:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a with identifier: 1987765
2026-03-27 22:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a with identifier: 1987765
2026-03-27 22:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a with identifier: 1987765 to the API
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 49214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a/68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/588af6166c7040c8b958ff108fe80570/images/large/9.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987765%27 HTTP/1.1" 200 None
2026-03-27 22:51:00 [ayvens.be] INFO: Saving data for 1987765: {'created_time': 1774651860.90915, 'last_price_update_time': 1774651860.909161, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987765') HTTP/1.1" 204 0
2026-03-27 22:51:00 [ayvens.be] INFO: Found listing with ID: 1986070
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986070%27 HTTP/1.1" 200 None
2026-03-27 22:51:00 [ayvens.be] INFO: Scrape type for 1986070: 2
2026-03-27 22:51:00 [ayvens.be] INFO: Extracting data for car ID: 1986070
2026-03-27 22:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-27 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee with scrape type 2
2026-03-27 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee with scrape type 2
2026-03-27 22:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc6db33d-5eeb-55e6-897a-3a94a462f6ee, identifier: 1986070
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item e766d7c7-5ddf-5382-bdb5-fa309286f765 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 64bdbd79-5fbe-5826-8e9f-888196c49dee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 68ab4412-1fc0-5b6d-a4b8-627a7e5d0a4a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-27 22:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-27 22:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070 to the API
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dc6db33d-5eeb-55e6-897a-3a94a462f6ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI 5 DOOR',
 'odometer': 57492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI 5 DOOR 1.5 COOPER',
 'transmission': 'manual',
 'trim': '1.5 COOPER',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986070%27 HTTP/1.1" 200 None
2026-03-27 22:51:01 [ayvens.be] INFO: Saving data for 1986070: {'auction_closing_time': 1775028600.0, 'created_time': 1774565201.982027, 'last_price_update_time': 1774651861.279068}
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986070') HTTP/1.1" 204 0
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d57194d0>
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/7.jpg saved to cache
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:01 [ayvens.be] INFO: Found listing with ID: 1986071
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986071%27 HTTP/1.1" 200 None
2026-03-27 22:51:01 [ayvens.be] INFO: Scrape type for 1986071: 2
2026-03-27 22:51:01 [ayvens.be] INFO: Extracting data for car ID: 1986071
2026-03-27 22:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-27 22:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with scrape type 2
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with scrape type 2
2026-03-27 22:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a, identifier: 1986071
2026-03-27 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-27 22:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-27 22:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071 to the API
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 37940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 B 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986071%27 HTTP/1.1" 200 None
2026-03-27 22:51:01 [ayvens.be] INFO: Saving data for 1986071: {'auction_closing_time': 1775028600.0, 'created_time': 1774565203.656065, 'last_price_update_time': 1774651861.741808}
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986071') HTTP/1.1" 204 0
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5690750>
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/6.jpg saved to cache
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5b88d10>
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/6.jpg saved to cache
2026-03-27 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ecf00300-7dd9-5e76-9b10-124f460f4e48 with identifier: 1987761
2026-03-27 22:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ecf00300-7dd9-5e76-9b10-124f460f4e48 with identifier: 1987761
2026-03-27 22:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ecf00300-7dd9-5e76-9b10-124f460f4e48 with identifier: 1987761 to the API
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:02 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'ecf00300-7dd9-5e76-9b10-124f460f4e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 89201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecf00300-7dd9-5e76-9b10-124f460f4e48/ecf00300-7dd9-5e76-9b10-124f460f4e48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/c3abcc83f69f460fa2bceca41ab04d64/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV PERFORMANCE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV PERFORMANCE AUTO 4WD',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987761%27 HTTP/1.1" 200 None
2026-03-27 22:51:02 [ayvens.be] INFO: Saving data for 1987761: {'created_time': 1774651862.265829, 'last_price_update_time': 1774651862.265839, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987761') HTTP/1.1" 204 0
2026-03-27 22:51:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 656c2f2a-d040-5dac-bc40-ac87a9381884 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8727a73-a269-5df0-8c14-7e6e0eddef3f with identifier: 1987760
2026-03-27 22:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8727a73-a269-5df0-8c14-7e6e0eddef3f with identifier: 1987760
2026-03-27 22:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8727a73-a269-5df0-8c14-7e6e0eddef3f with identifier: 1987760 to the API
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:02 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c8727a73-a269-5df0-8c14-7e6e0eddef3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 48085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8727a73-a269-5df0-8c14-7e6e0eddef3f/c8727a73-a269-5df0-8c14-7e6e0eddef3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/12663f6665b84ada9bfcb15a3a705a6d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987760%27 HTTP/1.1" 200 None
2026-03-27 22:51:02 [ayvens.be] INFO: Saving data for 1987760: {'created_time': 1774651862.642508, 'last_price_update_time': 1774651862.642519, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987760') HTTP/1.1" 204 0
2026-03-27 22:51:02 [ayvens.be] INFO: Found listing with ID: 1986072
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986072%27 HTTP/1.1" 200 None
2026-03-27 22:51:02 [ayvens.be] INFO: Scrape type for 1986072: 2
2026-03-27 22:51:02 [ayvens.be] INFO: Extracting data for car ID: 1986072
2026-03-27 22:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-27 22:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f with scrape type 2
2026-03-27 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f with scrape type 2
2026-03-27 22:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3eddde3-6de0-5a86-94ca-bf01d083fe0f, identifier: 1986072
2026-03-27 22:51:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item ecf00300-7dd9-5e76-9b10-124f460f4e48 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c8727a73-a269-5df0-8c14-7e6e0eddef3f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-27 22:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-27 22:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072 to the API
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a3eddde3-6de0-5a86-94ca-bf01d083fe0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 90381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986072%27 HTTP/1.1" 200 None
2026-03-27 22:51:03 [ayvens.be] INFO: Saving data for 1986072: {'auction_closing_time': 1775028600.0, 'created_time': 1774565206.110522, 'last_price_update_time': 1774651863.056661}
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986072') HTTP/1.1" 204 0
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d568e290>
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_3.jpg HTTP/1.1" 201 0
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Faba66268df3844b69245a8f110eb951f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/4.jpg saved to cache
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398
2026-03-27 22:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8953bb61-2ce9-52d1-ad78-7bf1a100c398, skipping ID generation
2026-03-27 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with scrape type 1
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8953bb61-2ce9-52d1-ad78-7bf1a100c398 sending to next pipeline
2026-03-27 22:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8953bb61-2ce9-52d1-ad78-7bf1a100c398, identifier: 1987503
2026-03-27 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:03 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-27 22:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with identifier: 1987503
2026-03-27 22:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with identifier: 1987503
2026-03-27 22:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8953bb61-2ce9-52d1-ad78-7bf1a100c398 with identifier: 1987503 to the API
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '8953bb61-2ce9-52d1-ad78-7bf1a100c398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41106',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 42365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8953bb61-2ce9-52d1-ad78-7bf1a100c398/8953bb61-2ce9-52d1-ad78-7bf1a100c398_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/aba66268df3844b69245a8f110eb951f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 1,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO 1 pl',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987503%27 HTTP/1.1" 200 None
2026-03-27 22:51:03 [ayvens.be] INFO: Saving data for 1987503: {'created_time': 1774651863.659309, 'last_price_update_time': 1774651863.659321, 'auction_closing_time': 1775037600.0}
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987503') HTTP/1.1" 204 0
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52fcd50>
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F987d9306682d4d448180614943b032d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/5.jpg saved to cache
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 656c2f2a-d040-5dac-bc40-ac87a9381884
2026-03-27 22:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 656c2f2a-d040-5dac-bc40-ac87a9381884, skipping ID generation
2026-03-27 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656c2f2a-d040-5dac-bc40-ac87a9381884 with scrape type 1
2026-03-27 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 656c2f2a-d040-5dac-bc40-ac87a9381884 sending to next pipeline
2026-03-27 22:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 656c2f2a-d040-5dac-bc40-ac87a9381884, identifier: 1987763
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d52ded10>
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/10.jpg saved to cache
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 656c2f2a-d040-5dac-bc40-ac87a9381884 with identifier: 1987763
2026-03-27 22:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 656c2f2a-d040-5dac-bc40-ac87a9381884 with identifier: 1987763
2026-03-27 22:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 656c2f2a-d040-5dac-bc40-ac87a9381884 with identifier: 1987763 to the API
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '656c2f2a-d040-5dac-bc40-ac87a9381884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 91007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c2f2a-d040-5dac-bc40-ac87a9381884/656c2f2a-d040-5dac-bc40-ac87a9381884_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/987d9306682d4d448180614943b032d1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116I (80KW)',
 'transmission': 'manual',
 'trim': '1.5 116I (80KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987763%27 HTTP/1.1" 200 None
2026-03-27 22:51:04 [ayvens.be] INFO: Saving data for 1987763: {'created_time': 1774651864.357894, 'last_price_update_time': 1774651864.357904, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987763') HTTP/1.1" 204 0
2026-03-27 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item a350168f-2c10-596c-8a85-8872b12afee0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item a350168f-2c10-596c-8a85-8872b12afee0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a350168f-2c10-596c-8a85-8872b12afee0 with identifier: 1987758
2026-03-27 22:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a350168f-2c10-596c-8a85-8872b12afee0 with identifier: 1987758
2026-03-27 22:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a350168f-2c10-596c-8a85-8872b12afee0 with identifier: 1987758 to the API
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:04 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a350168f-2c10-596c-8a85-8872b12afee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 62777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350168f-2c10-596c-8a85-8872b12afee0/a350168f-2c10-596c-8a85-8872b12afee0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ef16bf397f54a40be2930e15df1a535/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987758%27 HTTP/1.1" 200 None
2026-03-27 22:51:04 [ayvens.be] INFO: Saving data for 1987758: {'created_time': 1774651864.746675, 'last_price_update_time': 1774651864.746685, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987758') HTTP/1.1" 204 0
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a350168f-2c10-596c-8a85-8872b12afee0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5668110>
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/9.jpg saved to cache
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4e75510>
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F16425d64a0874b6b80bbaed6e0215628%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/3.jpg saved to cache
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b92d579-5f63-5587-a938-eb507f8b4413
2026-03-27 22:51:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b92d579-5f63-5587-a938-eb507f8b4413, skipping ID generation
2026-03-27 22:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b92d579-5f63-5587-a938-eb507f8b4413 with scrape type 1
2026-03-27 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b92d579-5f63-5587-a938-eb507f8b4413 sending to next pipeline
2026-03-27 22:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b92d579-5f63-5587-a938-eb507f8b4413, identifier: 1987759
2026-03-27 22:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b92d579-5f63-5587-a938-eb507f8b4413 with identifier: 1987759
2026-03-27 22:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b92d579-5f63-5587-a938-eb507f8b4413 with identifier: 1987759
2026-03-27 22:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b92d579-5f63-5587-a938-eb507f8b4413 with identifier: 1987759 to the API
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5b92d579-5f63-5587-a938-eb507f8b4413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 52266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b92d579-5f63-5587-a938-eb507f8b4413/5b92d579-5f63-5587-a938-eb507f8b4413_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/16425d64a0874b6b80bbaed6e0215628/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987759%27 HTTP/1.1" 200 None
2026-03-27 22:51:05 [ayvens.be] INFO: Saving data for 1987759: {'created_time': 1774651865.390218, 'last_price_update_time': 1774651865.390228, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987759') HTTP/1.1" 204 0
2026-03-27 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5675e50>
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb46529f6ef954849bcf3221f941dcabe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/1.jpg saved to cache
2026-03-27 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a71f290-0f8a-50dc-95a0-29633e1a139f
2026-03-27 22:51:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a71f290-0f8a-50dc-95a0-29633e1a139f, skipping ID generation
2026-03-27 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a71f290-0f8a-50dc-95a0-29633e1a139f with scrape type 1
2026-03-27 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a71f290-0f8a-50dc-95a0-29633e1a139f sending to next pipeline
2026-03-27 22:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a71f290-0f8a-50dc-95a0-29633e1a139f, identifier: 1987755
2026-03-27 22:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a71f290-0f8a-50dc-95a0-29633e1a139f with identifier: 1987755
2026-03-27 22:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a71f290-0f8a-50dc-95a0-29633e1a139f with identifier: 1987755
2026-03-27 22:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a71f290-0f8a-50dc-95a0-29633e1a139f with identifier: 1987755 to the API
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': '7a71f290-0f8a-50dc-95a0-29633e1a139f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 78392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a71f290-0f8a-50dc-95a0-29633e1a139f/7a71f290-0f8a-50dc-95a0-29633e1a139f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b46529f6ef954849bcf3221f941dcabe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987755%27 HTTP/1.1" 200 None
2026-03-27 22:51:05 [ayvens.be] INFO: Saving data for 1987755: {'created_time': 1774651865.883266, 'last_price_update_time': 1774651865.88328, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987755') HTTP/1.1" 204 0
2026-03-27 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d80bc850>
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F1c5201c64e55475ca70e39bd1ee426e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/9.jpg saved to cache
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcc36a77-9a3a-55f3-b466-9148d95345cc
2026-03-27 22:51:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcc36a77-9a3a-55f3-b466-9148d95345cc, skipping ID generation
2026-03-27 22:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc36a77-9a3a-55f3-b466-9148d95345cc with scrape type 1
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcc36a77-9a3a-55f3-b466-9148d95345cc sending to next pipeline
2026-03-27 22:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcc36a77-9a3a-55f3-b466-9148d95345cc, identifier: 1987756
2026-03-27 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcc36a77-9a3a-55f3-b466-9148d95345cc with identifier: 1987756
2026-03-27 22:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcc36a77-9a3a-55f3-b466-9148d95345cc with identifier: 1987756
2026-03-27 22:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dcc36a77-9a3a-55f3-b466-9148d95345cc with identifier: 1987756 to the API
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dcc36a77-9a3a-55f3-b466-9148d95345cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 98899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc36a77-9a3a-55f3-b466-9148d95345cc/dcc36a77-9a3a-55f3-b466-9148d95345cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/1c5201c64e55475ca70e39bd1ee426e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987756%27 HTTP/1.1" 200 None
2026-03-27 22:51:06 [ayvens.be] INFO: Saving data for 1987756: {'created_time': 1774651866.526628, 'last_price_update_time': 1774651866.52664, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987756') HTTP/1.1" 204 0
2026-03-27 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5f48390>
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F14acb0d684d844ffb0be886368a0c354%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/8.jpg saved to cache
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7c1dd1c-e46b-5076-8e63-a25766b6986d
2026-03-27 22:51:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7c1dd1c-e46b-5076-8e63-a25766b6986d, skipping ID generation
2026-03-27 22:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7c1dd1c-e46b-5076-8e63-a25766b6986d with scrape type 1
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7c1dd1c-e46b-5076-8e63-a25766b6986d sending to next pipeline
2026-03-27 22:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7c1dd1c-e46b-5076-8e63-a25766b6986d, identifier: 1987757
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5676210>
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/5.jpg saved to cache
2026-03-27 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7c1dd1c-e46b-5076-8e63-a25766b6986d with identifier: 1987757
2026-03-27 22:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7c1dd1c-e46b-5076-8e63-a25766b6986d with identifier: 1987757
2026-03-27 22:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7c1dd1c-e46b-5076-8e63-a25766b6986d with identifier: 1987757 to the API
2026-03-27 22:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e7c1dd1c-e46b-5076-8e63-a25766b6986d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 46831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c1dd1c-e46b-5076-8e63-a25766b6986d/e7c1dd1c-e46b-5076-8e63-a25766b6986d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/14acb0d684d844ffb0be886368a0c354/images/large/8.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987757%27 HTTP/1.1" 200 None
2026-03-27 22:51:07 [ayvens.be] INFO: Saving data for 1987757: {'created_time': 1774651867.172261, 'last_price_update_time': 1774651867.172271, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987757') HTTP/1.1" 204 0
2026-03-27 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item cc779181-835a-587b-936d-14c268d38b04 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item cc779181-835a-587b-936d-14c268d38b04 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 5 pages/min), scraped 240 items (at 81 items/min)
2026-03-27 22:51:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7330150>
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F0723b278d1b4411ab6a5b4f247543d62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/6.jpg saved to cache
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba
2026-03-27 22:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba, skipping ID generation
2026-03-27 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with scrape type 1
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74d9382c-78a9-5d1e-a78c-6fd35f7819ba sending to next pipeline
2026-03-27 22:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba, identifier: 1987749
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d7212a10>
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_6.jpg HTTP/1.1" 201 0
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ev%252F0681ffdcb86c4d48adab4acff4954ff5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/7.jpg saved to cache
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc779181-835a-587b-936d-14c268d38b04
2026-03-27 22:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc779181-835a-587b-936d-14c268d38b04, skipping ID generation
2026-03-27 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc779181-835a-587b-936d-14c268d38b04 with scrape type 1
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc779181-835a-587b-936d-14c268d38b04 sending to next pipeline
2026-03-27 22:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cc779181-835a-587b-936d-14c268d38b04, identifier: 1987747
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5d31a50>
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_2.jpg HTTP/1.1" 201 0
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/3.jpg saved to cache
2026-03-27 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with identifier: 1987749
2026-03-27 22:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with identifier: 1987749
2026-03-27 22:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 74d9382c-78a9-5d1e-a78c-6fd35f7819ba with identifier: 1987749 to the API
2026-03-27 22:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '74d9382c-78a9-5d1e-a78c-6fd35f7819ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 71078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d9382c-78a9-5d1e-a78c-6fd35f7819ba/74d9382c-78a9-5d1e-a78c-6fd35f7819ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/0723b278d1b4411ab6a5b4f247543d62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 1.5 BLUEHDI 75KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987749%27 HTTP/1.1" 200 None
2026-03-27 22:51:08 [ayvens.be] INFO: Saving data for 1987749: {'created_time': 1774651868.437718, 'last_price_update_time': 1774651868.437728, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987749') HTTP/1.1" 204 0
2026-03-27 22:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cc779181-835a-587b-936d-14c268d38b04 with identifier: 1987747
2026-03-27 22:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cc779181-835a-587b-936d-14c268d38b04 with identifier: 1987747
2026-03-27 22:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cc779181-835a-587b-936d-14c268d38b04 with identifier: 1987747 to the API
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cc779181-835a-587b-936d-14c268d38b04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 23281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc779181-835a-587b-936d-14c268d38b04/cc779181-835a-587b-936d-14c268d38b04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ev/0681ffdcb86c4d48adab4acff4954ff5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TSI ACT 110KW CLEVER',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT 110KW CLEVER',
 'vin': None,
 'year': 2024}
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987747%27 HTTP/1.1" 200 None
2026-03-27 22:51:08 [ayvens.be] INFO: Saving data for 1987747: {'created_time': 1774651868.773987, 'last_price_update_time': 1774651868.774003, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987747') HTTP/1.1" 204 0
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d56b5bd0>
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/2.jpg saved to cache
2026-03-27 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5548bd0>
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb1d4a0269e3845e7a1942748293d944f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/1.jpg saved to cache
2026-03-27 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5e3d776-cac0-5623-a6b8-936a2a82d794
2026-03-27 22:51:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5e3d776-cac0-5623-a6b8-936a2a82d794, skipping ID generation
2026-03-27 22:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e3d776-cac0-5623-a6b8-936a2a82d794 with scrape type 1
2026-03-27 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5e3d776-cac0-5623-a6b8-936a2a82d794 sending to next pipeline
2026-03-27 22:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5e3d776-cac0-5623-a6b8-936a2a82d794, identifier: 1987746
2026-03-27 22:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5e3d776-cac0-5623-a6b8-936a2a82d794 with identifier: 1987746
2026-03-27 22:51:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5e3d776-cac0-5623-a6b8-936a2a82d794 with identifier: 1987746
2026-03-27 22:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5e3d776-cac0-5623-a6b8-936a2a82d794 with identifier: 1987746 to the API
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MYTHOS BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e5e3d776-cac0-5623-a6b8-936a2a82d794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 31640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e3d776-cac0-5623-a6b8-936a2a82d794/e5e3d776-cac0-5623-a6b8-936a2a82d794_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b1d4a0269e3845e7a1942748293d944f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987746%27 HTTP/1.1" 200 None
2026-03-27 22:51:09 [ayvens.be] INFO: Saving data for 1987746: {'created_time': 1774651869.384881, 'last_price_update_time': 1774651869.384893, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987746') HTTP/1.1" 204 0
2026-03-27 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 61376484-f10f-5734-b90f-aef2709ee9f8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 61376484-f10f-5734-b90f-aef2709ee9f8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 61376484-f10f-5734-b90f-aef2709ee9f8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:09 [ayvens.be] INFO: Found listing with ID: 1986073
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986073%27 HTTP/1.1" 200 None
2026-03-27 22:51:09 [ayvens.be] INFO: Scrape type for 1986073: 2
2026-03-27 22:51:09 [ayvens.be] INFO: Extracting data for car ID: 1986073
2026-03-27 22:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-27 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with scrape type 2
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with scrape type 2
2026-03-27 22:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead, identifier: 1986073
2026-03-27 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d77d8d50>
2026-03-27 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fe8ce30d7a642447ca52abe3bb8528f4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/10.jpg saved to cache
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4163bc04-a99d-5d7f-973a-b4bba3428099
2026-03-27 22:51:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4163bc04-a99d-5d7f-973a-b4bba3428099, skipping ID generation
2026-03-27 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4163bc04-a99d-5d7f-973a-b4bba3428099 with scrape type 1
2026-03-27 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4163bc04-a99d-5d7f-973a-b4bba3428099 sending to next pipeline
2026-03-27 22:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4163bc04-a99d-5d7f-973a-b4bba3428099, identifier: 1987745
2026-03-27 22:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-27 22:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-27 22:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073 to the API
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9fa71a98-41e8-5bbe-99a8-dff2a6c43ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 188830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986073%27 HTTP/1.1" 200 None
2026-03-27 22:51:10 [ayvens.be] INFO: Saving data for 1986073: {'auction_closing_time': 1775028600.0, 'created_time': 1774565207.436747, 'last_price_update_time': 1774651870.004471}
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986073') HTTP/1.1" 204 0
2026-03-27 22:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4163bc04-a99d-5d7f-973a-b4bba3428099 with identifier: 1987745
2026-03-27 22:51:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4163bc04-a99d-5d7f-973a-b4bba3428099 with identifier: 1987745
2026-03-27 22:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4163bc04-a99d-5d7f-973a-b4bba3428099 with identifier: 1987745 to the API
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'MAGNETIC GREY METALLISEE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4163bc04-a99d-5d7f-973a-b4bba3428099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163bc04-a99d-5d7f-973a-b4bba3428099/4163bc04-a99d-5d7f-973a-b4bba3428099_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/e8ce30d7a642447ca52abe3bb8528f4e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM DESIGN',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM DESIGN',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987745%27 HTTP/1.1" 200 None
2026-03-27 22:51:10 [ayvens.be] INFO: Saving data for 1987745: {'created_time': 1774651870.339665, 'last_price_update_time': 1774651870.339675, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987745') HTTP/1.1" 204 0
2026-03-27 22:51:10 [ayvens.be] INFO: Found listing with ID: 1986074
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986074%27 HTTP/1.1" 200 None
2026-03-27 22:51:10 [ayvens.be] INFO: Scrape type for 1986074: 2
2026-03-27 22:51:10 [ayvens.be] INFO: Extracting data for car ID: 1986074
2026-03-27 22:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-27 22:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c363ea-e892-5a47-b252-9beca2f973a5 with scrape type 2
2026-03-27 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1c363ea-e892-5a47-b252-9beca2f973a5 with scrape type 2
2026-03-27 22:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1c363ea-e892-5a47-b252-9beca2f973a5, identifier: 1986074
2026-03-27 22:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-27 22:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-27 22:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074 to the API
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e1c363ea-e892-5a47-b252-9beca2f973a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPAu2030',
 'odometer': 101108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPAu2030 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986074%27 HTTP/1.1" 200 None
2026-03-27 22:51:10 [ayvens.be] INFO: Saving data for 1986074: {'auction_closing_time': 1775028600.0, 'created_time': 1774565208.617076, 'last_price_update_time': 1774651870.712865}
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986074') HTTP/1.1" 204 0
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d540ed10>
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/10.jpg saved to cache
2026-03-27 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5a2e4d0>
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/2.jpg saved to cache
2026-03-27 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d5ac1a50>
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F126a021160544baaa1f49e5433f9d1bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/1.jpg saved to cache
2026-03-27 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61376484-f10f-5734-b90f-aef2709ee9f8
2026-03-27 22:51:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61376484-f10f-5734-b90f-aef2709ee9f8, skipping ID generation
2026-03-27 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61376484-f10f-5734-b90f-aef2709ee9f8 with scrape type 1
2026-03-27 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61376484-f10f-5734-b90f-aef2709ee9f8 sending to next pipeline
2026-03-27 22:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61376484-f10f-5734-b90f-aef2709ee9f8, identifier: 1987740
2026-03-27 22:51:11 [ayvens.be] INFO: Found listing with ID: 1986075
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986075%27 HTTP/1.1" 200 None
2026-03-27 22:51:11 [ayvens.be] INFO: Scrape type for 1986075: 2
2026-03-27 22:51:11 [ayvens.be] INFO: Extracting data for car ID: 1986075
2026-03-27 22:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-27 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b with scrape type 2
2026-03-27 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b with scrape type 2
2026-03-27 22:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 29d307d9-05dd-5759-b99d-a5f9d0d3678b, identifier: 1986075
2026-03-27 22:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61376484-f10f-5734-b90f-aef2709ee9f8 with identifier: 1987740
2026-03-27 22:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61376484-f10f-5734-b90f-aef2709ee9f8 with identifier: 1987740
2026-03-27 22:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61376484-f10f-5734-b90f-aef2709ee9f8 with identifier: 1987740 to the API
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '61376484-f10f-5734-b90f-aef2709ee9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 47290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61376484-f10f-5734-b90f-aef2709ee9f8/61376484-f10f-5734-b90f-aef2709ee9f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/126a021160544baaa1f49e5433f9d1bb/images/large/9.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987740%27 HTTP/1.1" 200 None
2026-03-27 22:51:11 [ayvens.be] INFO: Saving data for 1987740: {'created_time': 1774651871.688133, 'last_price_update_time': 1774651871.688143, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987740') HTTP/1.1" 204 0
2026-03-27 22:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-27 22:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-27 22:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075 to the API
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '29d307d9-05dd-5759-b99d-a5f9d0d3678b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 92706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Active',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986075%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Saving data for 1986075: {'auction_closing_time': 1775028600.0, 'created_time': 1774565211.73045, 'last_price_update_time': 1774651872.038574}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986075') HTTP/1.1" 204 0
2026-03-27 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 22:51:12 [ayvens.be] INFO: Found listing with ID: 1986076
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986076%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Scrape type for 1986076: 2
2026-03-27 22:51:12 [ayvens.be] INFO: Extracting data for car ID: 1986076
2026-03-27 22:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-27 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39eec9d8-b033-5f55-9e59-aea05ec9d786 with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39eec9d8-b033-5f55-9e59-aea05ec9d786 with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39eec9d8-b033-5f55-9e59-aea05ec9d786, identifier: 1986076
2026-03-27 22:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-27 22:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-27 22:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076 to the API
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '39eec9d8-b033-5f55-9e59-aea05ec9d786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 75241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 180 d',
 'transmission': 'automatic',
 'trim': 'GLB 180 d',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986076%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Saving data for 1986076: {'auction_closing_time': 1775028600.0, 'created_time': 1774565213.376642, 'last_price_update_time': 1774651872.429332}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986076') HTTP/1.1" 204 0
2026-03-27 22:51:12 [ayvens.be] INFO: Found listing with ID: 1986077
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986077%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Scrape type for 1986077: 2
2026-03-27 22:51:12 [ayvens.be] INFO: Extracting data for car ID: 1986077
2026-03-27 22:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-27 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130e9508-25a0-512c-84c2-a8a8de268073 with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130e9508-25a0-512c-84c2-a8a8de268073 with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 130e9508-25a0-512c-84c2-a8a8de268073, identifier: 1986077
2026-03-27 22:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-27 22:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-27 22:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077 to the API
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '130e9508-25a0-512c-84c2-a8a8de268073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 96175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 105KW 314 L1 FWD 3.5T FUNCTIONAL',
 'transmission': 'manual',
 'trim': '2.1CDI 105KW 314 L1 FWD 3.5T FUNCTIONAL',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986077%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Saving data for 1986077: {'auction_closing_time': 1775028600.0, 'created_time': 1774565214.905524, 'last_price_update_time': 1774651872.806104}
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986077') HTTP/1.1" 204 0
2026-03-27 22:51:12 [ayvens.be] INFO: Found listing with ID: 1986078
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986078%27 HTTP/1.1" 200 None
2026-03-27 22:51:12 [ayvens.be] INFO: Scrape type for 1986078: 2
2026-03-27 22:51:12 [ayvens.be] INFO: Extracting data for car ID: 1986078
2026-03-27 22:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-27 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a389b135-5d76-5c6e-b940-246705a2ed4e with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a389b135-5d76-5c6e-b940-246705a2ed4e with scrape type 2
2026-03-27 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a389b135-5d76-5c6e-b940-246705a2ed4e, identifier: 1986078
2026-03-27 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3d4596210>
2026-03-27 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Ff567e20f4d3c42c998154359b26d48a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/9.jpg saved to cache
2026-03-27 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b86a3504-50fa-5705-a330-fb01e1cd0ea6
2026-03-27 22:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b86a3504-50fa-5705-a330-fb01e1cd0ea6, skipping ID generation
2026-03-27 22:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 with scrape type 1
2026-03-27 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b86a3504-50fa-5705-a330-fb01e1cd0ea6 sending to next pipeline
2026-03-27 22:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b86a3504-50fa-5705-a330-fb01e1cd0ea6, identifier: 1987739
2026-03-27 22:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-27 22:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-27 22:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078 to the API
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a389b135-5d76-5c6e-b940-246705a2ed4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 41950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986078%27 HTTP/1.1" 200 None
2026-03-27 22:51:13 [ayvens.be] INFO: Saving data for 1986078: {'auction_closing_time': 1775028600.0, 'created_time': 1774565215.886504, 'last_price_update_time': 1774651873.364981}
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986078') HTTP/1.1" 204 0
2026-03-27 22:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b86a3504-50fa-5705-a330-fb01e1cd0ea6 with identifier: 1987739
2026-03-27 22:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b86a3504-50fa-5705-a330-fb01e1cd0ea6 with identifier: 1987739
2026-03-27 22:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b86a3504-50fa-5705-a330-fb01e1cd0ea6 with identifier: 1987739 to the API
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-02T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b86a3504-50fa-5705-a330-fb01e1cd0ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41109',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 48702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86a3504-50fa-5705-a330-fb01e1cd0ea6/b86a3504-50fa-5705-a330-fb01e1cd0ea6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/f567e20f4d3c42c998154359b26d48a7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271987739%27 HTTP/1.1" 200 None
2026-03-27 22:51:14 [ayvens.be] INFO: Saving data for 1987739: {'created_time': 1774651874.759691, 'last_price_update_time': 1774651874.759701, 'auction_closing_time': 1775115000.0}
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1987739') HTTP/1.1" 204 0
2026-03-27 22:51:14 [ayvens.be] INFO: Found listing with ID: 1986079
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986079%27 HTTP/1.1" 200 None
2026-03-27 22:51:14 [ayvens.be] INFO: Scrape type for 1986079: 2
2026-03-27 22:51:14 [ayvens.be] INFO: Extracting data for car ID: 1986079
2026-03-27 22:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-27 22:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0ae577-68d3-564d-b024-571a2b36e74e with scrape type 2
2026-03-27 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac0ae577-68d3-564d-b024-571a2b36e74e with scrape type 2
2026-03-27 22:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac0ae577-68d3-564d-b024-571a2b36e74e, identifier: 1986079
2026-03-27 22:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-27 22:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-27 22:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079 to the API
2026-03-27 22:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ac0ae577-68d3-564d-b024-571a2b36e74e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Tiguan',
 'odometer': 196214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Tiguan 1.5 TSI COMFORTLINE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI COMFORTLINE DSG',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986079%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Saving data for 1986079: {'auction_closing_time': 1775028600.0, 'created_time': 1774565217.31005, 'last_price_update_time': 1774651875.158662}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986079') HTTP/1.1" 204 0
2026-03-27 22:51:15 [ayvens.be] INFO: Found listing with ID: 1986080
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986080%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Scrape type for 1986080: 2
2026-03-27 22:51:15 [ayvens.be] INFO: Extracting data for car ID: 1986080
2026-03-27 22:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-27 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6002d677-f9a6-5436-94d1-f956b03575d0 with scrape type 2
2026-03-27 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6002d677-f9a6-5436-94d1-f956b03575d0 with scrape type 2
2026-03-27 22:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6002d677-f9a6-5436-94d1-f956b03575d0, identifier: 1986080
2026-03-27 22:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-27 22:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-27 22:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080 to the API
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6002d677-f9a6-5436-94d1-f956b03575d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 68076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 90KW LIFE',
 'transmission': 'manual',
 'trim': '2.0 TDI 90KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986080%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Saving data for 1986080: {'auction_closing_time': 1775028600.0, 'created_time': 1774565219.181671, 'last_price_update_time': 1774651875.536163}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986080') HTTP/1.1" 204 0
2026-03-27 22:51:15 [ayvens.be] INFO: Found listing with ID: 1986081
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986081%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Scrape type for 1986081: 2
2026-03-27 22:51:15 [ayvens.be] INFO: Extracting data for car ID: 1986081
2026-03-27 22:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-27 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with scrape type 2
2026-03-27 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with scrape type 2
2026-03-27 22:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa, identifier: 1986081
2026-03-27 22:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-27 22:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-27 22:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081 to the API
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '36c7a8a2-e03e-563f-8ba2-5ee7a63717aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 40864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986081%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Saving data for 1986081: {'auction_closing_time': 1775028600.0, 'created_time': 1774565220.29481, 'last_price_update_time': 1774651875.898513}
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986081') HTTP/1.1" 204 0
2026-03-27 22:51:15 [ayvens.be] INFO: Found listing with ID: 1986082
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986082%27 HTTP/1.1" 200 None
2026-03-27 22:51:15 [ayvens.be] INFO: Scrape type for 1986082: 2
2026-03-27 22:51:15 [ayvens.be] INFO: Extracting data for car ID: 1986082
2026-03-27 22:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-27 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f468d374-ccd1-5d52-b210-0d5cf63ead13 with scrape type 2
2026-03-27 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f468d374-ccd1-5d52-b210-0d5cf63ead13 with scrape type 2
2026-03-27 22:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f468d374-ccd1-5d52-b210-0d5cf63ead13, identifier: 1986082
2026-03-27 22:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-27 22:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-27 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082 to the API
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f468d374-ccd1-5d52-b210-0d5cf63ead13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 114184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986082%27 HTTP/1.1" 200 None
2026-03-27 22:51:16 [ayvens.be] INFO: Saving data for 1986082: {'auction_closing_time': 1775028600.0, 'created_time': 1774565222.692336, 'last_price_update_time': 1774651876.299633}
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986082') HTTP/1.1" 204 0
2026-03-27 22:51:16 [ayvens.be] INFO: Found listing with ID: 1986083
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986083%27 HTTP/1.1" 200 None
2026-03-27 22:51:16 [ayvens.be] INFO: Scrape type for 1986083: 2
2026-03-27 22:51:16 [ayvens.be] INFO: Extracting data for car ID: 1986083
2026-03-27 22:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-27 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with scrape type 2
2026-03-27 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with scrape type 2
2026-03-27 22:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b, identifier: 1986083
2026-03-27 22:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-27 22:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-27 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083 to the API
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2cb39d9d-bb0f-5553-91eb-eb616d811f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 82007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986083%27 HTTP/1.1" 200 None
2026-03-27 22:51:16 [ayvens.be] INFO: Saving data for 1986083: {'auction_closing_time': 1775028600.0, 'created_time': 1774565224.329799, 'last_price_update_time': 1774651876.727884}
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986083') HTTP/1.1" 204 0
2026-03-27 22:51:16 [ayvens.be] INFO: Found listing with ID: 1986084
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986084%27 HTTP/1.1" 200 None
2026-03-27 22:51:16 [ayvens.be] INFO: Scrape type for 1986084: 2
2026-03-27 22:51:16 [ayvens.be] INFO: Extracting data for car ID: 1986084
2026-03-27 22:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-27 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf05fb0-a1b8-56dc-9421-ae702229d085 with scrape type 2
2026-03-27 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf05fb0-a1b8-56dc-9421-ae702229d085 with scrape type 2
2026-03-27 22:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abf05fb0-a1b8-56dc-9421-ae702229d085, identifier: 1986084
2026-03-27 22:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-27 22:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-27 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084 to the API
2026-03-27 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'abf05fb0-a1b8-56dc-9421-ae702229d085',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 153675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986084%27 HTTP/1.1" 200 None
2026-03-27 22:51:17 [ayvens.be] INFO: Saving data for 1986084: {'auction_closing_time': 1775028600.0, 'created_time': 1774565225.686637, 'last_price_update_time': 1774651877.121232}
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986084') HTTP/1.1" 204 0
2026-03-27 22:51:17 [ayvens.be] INFO: Found listing with ID: 1986085
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986085%27 HTTP/1.1" 200 None
2026-03-27 22:51:17 [ayvens.be] INFO: Scrape type for 1986085: 2
2026-03-27 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1986085
2026-03-27 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-27 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5f4d0d-5182-5124-9122-5262a27fe735 with scrape type 2
2026-03-27 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5f4d0d-5182-5124-9122-5262a27fe735 with scrape type 2
2026-03-27 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf5f4d0d-5182-5124-9122-5262a27fe735, identifier: 1986085
2026-03-27 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-27 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-27 22:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085 to the API
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cf5f4d0d-5182-5124-9122-5262a27fe735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 141000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 S&S ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986085%27 HTTP/1.1" 200 None
2026-03-27 22:51:17 [ayvens.be] INFO: Saving data for 1986085: {'auction_closing_time': 1775028600.0, 'created_time': 1774565228.365214, 'last_price_update_time': 1774651877.560935}
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986085') HTTP/1.1" 204 0
2026-03-27 22:51:17 [ayvens.be] INFO: Found listing with ID: 1986086
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986086%27 HTTP/1.1" 200 None
2026-03-27 22:51:17 [ayvens.be] INFO: Scrape type for 1986086: 2
2026-03-27 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1986086
2026-03-27 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-27 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab31278-8474-5fb0-b017-07fe457e9b85 with scrape type 2
2026-03-27 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab31278-8474-5fb0-b017-07fe457e9b85 with scrape type 2
2026-03-27 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ab31278-8474-5fb0-b017-07fe457e9b85, identifier: 1986086
2026-03-27 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-27 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-27 22:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086 to the API
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5ab31278-8474-5fb0-b017-07fe457e9b85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986086%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Saving data for 1986086: {'auction_closing_time': 1775028600.0, 'created_time': 1774565229.836965, 'last_price_update_time': 1774651878.032564}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986086') HTTP/1.1" 204 0
2026-03-27 22:51:18 [ayvens.be] INFO: Found listing with ID: 1986087
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986087%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Scrape type for 1986087: 2
2026-03-27 22:51:18 [ayvens.be] INFO: Extracting data for car ID: 1986087
2026-03-27 22:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-27 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46, identifier: 1986087
2026-03-27 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-27 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-27 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087 to the API
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '99135a3f-f7a2-5591-a39c-c1ee2be1dc46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 126334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986087%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Saving data for 1986087: {'auction_closing_time': 1775028600.0, 'created_time': 1774565231.083902, 'last_price_update_time': 1774651878.426407}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986087') HTTP/1.1" 204 0
2026-03-27 22:51:18 [ayvens.be] INFO: Found listing with ID: 1986088
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986088%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Scrape type for 1986088: 2
2026-03-27 22:51:18 [ayvens.be] INFO: Extracting data for car ID: 1986088
2026-03-27 22:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-27 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ac92778-2e6d-51b5-a3d8-10524ea99f71, identifier: 1986088
2026-03-27 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-27 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-27 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088 to the API
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '1ac92778-2e6d-51b5-a3d8-10524ea99f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 107659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986088%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Saving data for 1986088: {'auction_closing_time': 1775028600.0, 'created_time': 1774565232.902704, 'last_price_update_time': 1774651878.800556}
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986088') HTTP/1.1" 204 0
2026-03-27 22:51:18 [ayvens.be] INFO: Found listing with ID: 1986089
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986089%27 HTTP/1.1" 200 None
2026-03-27 22:51:18 [ayvens.be] INFO: Scrape type for 1986089: 2
2026-03-27 22:51:18 [ayvens.be] INFO: Extracting data for car ID: 1986089
2026-03-27 22:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-27 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e with scrape type 2
2026-03-27 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f2278d22-bc6b-5ae7-a622-e79eb64ea72e, identifier: 1986089
2026-03-27 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-27 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-27 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089 to the API
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f2278d22-bc6b-5ae7-a622-e79eb64ea72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 119957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986089%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Saving data for 1986089: {'auction_closing_time': 1775028600.0, 'created_time': 1774565234.429851, 'last_price_update_time': 1774651879.186962}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986089') HTTP/1.1" 204 0
2026-03-27 22:51:19 [ayvens.be] INFO: Found listing with ID: 1986090
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986090%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Scrape type for 1986090: 2
2026-03-27 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1986090
2026-03-27 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-27 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8e390a-818c-5cb0-8ed8-efc7879adb32 with scrape type 2
2026-03-27 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8e390a-818c-5cb0-8ed8-efc7879adb32 with scrape type 2
2026-03-27 22:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab8e390a-818c-5cb0-8ed8-efc7879adb32, identifier: 1986090
2026-03-27 22:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-27 22:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-27 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090 to the API
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ab8e390a-818c-5cb0-8ed8-efc7879adb32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER SWB DIESEL',
 'odometer': 171461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER SWB DIESEL 1.5 BlueHDi Standard Allure AGC S&S',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Standard Allure AGC S&S',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986090%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Saving data for 1986090: {'auction_closing_time': 1775028600.0, 'created_time': 1774565236.091017, 'last_price_update_time': 1774651879.57975}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986090') HTTP/1.1" 204 0
2026-03-27 22:51:19 [ayvens.be] INFO: Found listing with ID: 1986091
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986091%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Scrape type for 1986091: 2
2026-03-27 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1986091
2026-03-27 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-27 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d with scrape type 2
2026-03-27 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d with scrape type 2
2026-03-27 22:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e679bfcc-7b17-50d8-b2fb-cb19d684a68d, identifier: 1986091
2026-03-27 22:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-27 22:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-27 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091 to the API
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e679bfcc-7b17-50d8-b2fb-cb19d684a68d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 171408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986091%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Saving data for 1986091: {'auction_closing_time': 1775028600.0, 'created_time': 1774565238.383889, 'last_price_update_time': 1774651879.962307}
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986091') HTTP/1.1" 204 0
2026-03-27 22:51:19 [ayvens.be] INFO: Found listing with ID: 1986092
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986092%27 HTTP/1.1" 200 None
2026-03-27 22:51:19 [ayvens.be] INFO: Scrape type for 1986092: 2
2026-03-27 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1986092
2026-03-27 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-27 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5180510f-bf8c-5918-b9d0-c59c4af40884 with scrape type 2
2026-03-27 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5180510f-bf8c-5918-b9d0-c59c4af40884 with scrape type 2
2026-03-27 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5180510f-bf8c-5918-b9d0-c59c4af40884, identifier: 1986092
2026-03-27 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-27 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-27 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092 to the API
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5180510f-bf8c-5918-b9d0-c59c4af40884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPAu2030',
 'odometer': 108986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPAu2030 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986092%27 HTTP/1.1" 200 None
2026-03-27 22:51:20 [ayvens.be] INFO: Saving data for 1986092: {'auction_closing_time': 1775028600.0, 'created_time': 1774565240.064697, 'last_price_update_time': 1774651880.344689}
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986092') HTTP/1.1" 204 0
2026-03-27 22:51:20 [ayvens.be] INFO: Found listing with ID: 1986093
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986093%27 HTTP/1.1" 200 None
2026-03-27 22:51:20 [ayvens.be] INFO: Scrape type for 1986093: 2
2026-03-27 22:51:20 [ayvens.be] INFO: Extracting data for car ID: 1986093
2026-03-27 22:51:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-27 22:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90900cd-b928-549e-9757-b894d285e993 with scrape type 2
2026-03-27 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90900cd-b928-549e-9757-b894d285e993 with scrape type 2
2026-03-27 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b90900cd-b928-549e-9757-b894d285e993, identifier: 1986093
2026-03-27 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-27 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-27 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093 to the API
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b90900cd-b928-549e-9757-b894d285e993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 133565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986093%27 HTTP/1.1" 200 None
2026-03-27 22:51:20 [ayvens.be] INFO: Saving data for 1986093: {'auction_closing_time': 1775028600.0, 'created_time': 1774565241.593402, 'last_price_update_time': 1774651880.735118}
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986093') HTTP/1.1" 204 0
2026-03-27 22:51:20 [ayvens.be] INFO: Found listing with ID: 1986094
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986094%27 HTTP/1.1" 200 None
2026-03-27 22:51:20 [ayvens.be] INFO: Scrape type for 1986094: 2
2026-03-27 22:51:20 [ayvens.be] INFO: Extracting data for car ID: 1986094
2026-03-27 22:51:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-27 22:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2210c3c3-db88-5842-8418-cbfbdbf20245 with scrape type 2
2026-03-27 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2210c3c3-db88-5842-8418-cbfbdbf20245 with scrape type 2
2026-03-27 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2210c3c3-db88-5842-8418-cbfbdbf20245, identifier: 1986094
2026-03-27 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-27 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-27 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094 to the API
2026-03-27 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2210c3c3-db88-5842-8418-cbfbdbf20245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 147472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986094%27 HTTP/1.1" 200 None
2026-03-27 22:51:21 [ayvens.be] INFO: Saving data for 1986094: {'auction_closing_time': 1775028600.0, 'created_time': 1774565244.037265, 'last_price_update_time': 1774651881.143535}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986094') HTTP/1.1" 204 0
2026-03-27 22:51:21 [ayvens.be] INFO: Found listing with ID: 1986095
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986095%27 HTTP/1.1" 200 None
2026-03-27 22:51:21 [ayvens.be] INFO: Scrape type for 1986095: 2
2026-03-27 22:51:21 [ayvens.be] INFO: Extracting data for car ID: 1986095
2026-03-27 22:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-27 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with scrape type 2
2026-03-27 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with scrape type 2
2026-03-27 22:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2, identifier: 1986095
2026-03-27 22:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-27 22:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-27 22:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095 to the API
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '61b6d6b6-83de-527e-a30b-7d1dcea0a6a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 188584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 B3 MHEV MOMENTUM PRO AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B3 MHEV MOMENTUM PRO AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986095%27 HTTP/1.1" 200 None
2026-03-27 22:51:21 [ayvens.be] INFO: Saving data for 1986095: {'auction_closing_time': 1775028600.0, 'created_time': 1774565260.904431, 'last_price_update_time': 1774651881.525812}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986095') HTTP/1.1" 204 0
2026-03-27 22:51:21 [ayvens.be] INFO: Found listing with ID: 1986096
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986096%27 HTTP/1.1" 200 None
2026-03-27 22:51:21 [ayvens.be] INFO: Scrape type for 1986096: 2
2026-03-27 22:51:21 [ayvens.be] INFO: Extracting data for car ID: 1986096
2026-03-27 22:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-27 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with scrape type 2
2026-03-27 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with scrape type 2
2026-03-27 22:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda00ae2-cb85-5aaf-8fae-4fc7773133b1, identifier: 1986096
2026-03-27 22:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-27 22:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-27 22:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096 to the API
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda00ae2-cb85-5aaf-8fae-4fc7773133b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 55309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986096%27 HTTP/1.1" 200 None
2026-03-27 22:51:21 [ayvens.be] INFO: Saving data for 1986096: {'auction_closing_time': 1775028600.0, 'created_time': 1774565255.996619, 'last_price_update_time': 1774651881.891678}
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986096') HTTP/1.1" 204 0
2026-03-27 22:51:22 [ayvens.be] INFO: Found listing with ID: 1986097
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986097%27 HTTP/1.1" 200 None
2026-03-27 22:51:22 [ayvens.be] INFO: Scrape type for 1986097: 2
2026-03-27 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1986097
2026-03-27 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-27 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b897af89-92d5-5fd7-96fb-123d33a94a50 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b897af89-92d5-5fd7-96fb-123d33a94a50 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b897af89-92d5-5fd7-96fb-123d33a94a50, identifier: 1986097
2026-03-27 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-27 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-27 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097 to the API
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b897af89-92d5-5fd7-96fb-123d33a94a50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 152950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986097%27 HTTP/1.1" 200 None
2026-03-27 22:51:22 [ayvens.be] INFO: Saving data for 1986097: {'auction_closing_time': 1775028600.0, 'created_time': 1774565253.490316, 'last_price_update_time': 1774651882.379592}
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986097') HTTP/1.1" 204 0
2026-03-27 22:51:22 [ayvens.be] INFO: Found listing with ID: 1986098
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986098%27 HTTP/1.1" 200 None
2026-03-27 22:51:22 [ayvens.be] INFO: Scrape type for 1986098: 2
2026-03-27 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1986098
2026-03-27 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-27 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36, identifier: 1986098
2026-03-27 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-27 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-27 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098 to the API
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'de3c7f05-fd73-53d0-9829-e3d2e4cb7d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'OPTIMA SPORTSWAGON PHEV - 2019',
 'odometer': 142856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA OPTIMA SPORTSWAGON PHEV - 2019 2.0 GDi PHEV Sense (EU6d-T.)',
 'transmission': 'automatic',
 'trim': '2.0 GDi PHEV Sense (EU6d-T.)',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986098%27 HTTP/1.1" 200 None
2026-03-27 22:51:22 [ayvens.be] INFO: Saving data for 1986098: {'auction_closing_time': 1775028600.0, 'created_time': 1774565248.828598, 'last_price_update_time': 1774651882.764211}
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986098') HTTP/1.1" 204 0
2026-03-27 22:51:22 [ayvens.be] INFO: Found listing with ID: 1986099
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986099%27 HTTP/1.1" 200 None
2026-03-27 22:51:22 [ayvens.be] INFO: Scrape type for 1986099: 2
2026-03-27 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1986099
2026-03-27 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-27 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3dca273-170e-552b-ad06-a9ed40af2ea1 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3dca273-170e-552b-ad06-a9ed40af2ea1 with scrape type 2
2026-03-27 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e3dca273-170e-552b-ad06-a9ed40af2ea1, identifier: 1986099
2026-03-27 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-27 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-27 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099 to the API
2026-03-27 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e3dca273-170e-552b-ad06-a9ed40af2ea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 136991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986099%27 HTTP/1.1" 200 None
2026-03-27 22:51:23 [ayvens.be] INFO: Saving data for 1986099: {'auction_closing_time': 1775028600.0, 'created_time': 1774565250.303148, 'last_price_update_time': 1774651883.167835}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986099') HTTP/1.1" 204 0
2026-03-27 22:51:23 [ayvens.be] INFO: Found listing with ID: 1986100
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986100%27 HTTP/1.1" 200 None
2026-03-27 22:51:23 [ayvens.be] INFO: Scrape type for 1986100: 2
2026-03-27 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1986100
2026-03-27 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-27 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 917f2936-fc79-57a2-8b59-fbf3f397ac37 with scrape type 2
2026-03-27 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 917f2936-fc79-57a2-8b59-fbf3f397ac37 with scrape type 2
2026-03-27 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 917f2936-fc79-57a2-8b59-fbf3f397ac37, identifier: 1986100
2026-03-27 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-27 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-27 22:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100 to the API
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'MYTHOS BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '917f2936-fc79-57a2-8b59-fbf3f397ac37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 174014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986100%27 HTTP/1.1" 200 None
2026-03-27 22:51:23 [ayvens.be] INFO: Saving data for 1986100: {'auction_closing_time': 1775028600.0, 'created_time': 1774565254.820748, 'last_price_update_time': 1774651883.561137}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986100') HTTP/1.1" 204 0
2026-03-27 22:51:23 [ayvens.be] INFO: Found listing with ID: 1986101
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986101%27 HTTP/1.1" 200 None
2026-03-27 22:51:23 [ayvens.be] INFO: Scrape type for 1986101: 2
2026-03-27 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1986101
2026-03-27 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-27 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59805e72-f6f4-5022-ad2e-bc7240d6c422 with scrape type 2
2026-03-27 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59805e72-f6f4-5022-ad2e-bc7240d6c422 with scrape type 2
2026-03-27 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59805e72-f6f4-5022-ad2e-bc7240d6c422, identifier: 1986101
2026-03-27 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-27 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-27 22:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101 to the API
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '59805e72-f6f4-5022-ad2e-bc7240d6c422',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE CLA  COUPE DIESEL (C118',
 'odometer': 127894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE CLA  COUPE DIESEL (C118 CLA 180 d Business '
          'Solution',
 'transmission': 'automatic',
 'trim': 'CLA 180 d Business Solution',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986101%27 HTTP/1.1" 200 None
2026-03-27 22:51:23 [ayvens.be] INFO: Saving data for 1986101: {'auction_closing_time': 1775028600.0, 'created_time': 1774565253.851652, 'last_price_update_time': 1774651883.980429}
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986101') HTTP/1.1" 204 0
2026-03-27 22:51:23 [ayvens.be] INFO: Found listing with ID: 1986102
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986102%27 HTTP/1.1" 200 None
2026-03-27 22:51:24 [ayvens.be] INFO: Scrape type for 1986102: 2
2026-03-27 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1986102
2026-03-27 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-27 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe663be6-9724-57b4-b3f9-c897ef50756e with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe663be6-9724-57b4-b3f9-c897ef50756e with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe663be6-9724-57b4-b3f9-c897ef50756e, identifier: 1986102
2026-03-27 22:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-27 22:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-27 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102 to the API
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe663be6-9724-57b4-b3f9-c897ef50756e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 86792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.6 PHEV 225 E-AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986102%27 HTTP/1.1" 200 None
2026-03-27 22:51:24 [ayvens.be] INFO: Saving data for 1986102: {'auction_closing_time': 1775028600.0, 'created_time': 1774565256.677537, 'last_price_update_time': 1774651884.368727}
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986102') HTTP/1.1" 204 0
2026-03-27 22:51:24 [ayvens.be] INFO: Found listing with ID: 1986103
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986103%27 HTTP/1.1" 200 None
2026-03-27 22:51:24 [ayvens.be] INFO: Scrape type for 1986103: 2
2026-03-27 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1986103
2026-03-27 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-27 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3, identifier: 1986103
2026-03-27 22:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-27 22:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-27 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103 to the API
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 15063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986103%27 HTTP/1.1" 200 None
2026-03-27 22:51:24 [ayvens.be] INFO: Saving data for 1986103: {'auction_closing_time': 1775028600.0, 'created_time': 1774565257.955792, 'last_price_update_time': 1774651884.74759}
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986103') HTTP/1.1" 204 0
2026-03-27 22:51:24 [ayvens.be] INFO: Found listing with ID: 1986104
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986104%27 HTTP/1.1" 200 None
2026-03-27 22:51:24 [ayvens.be] INFO: Scrape type for 1986104: 2
2026-03-27 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1986104
2026-03-27 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-27 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with scrape type 2
2026-03-27 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26ad01cb-b78b-5f5e-b11d-de81424be4a4, identifier: 1986104
2026-03-27 22:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-27 22:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-27 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104 to the API
2026-03-27 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26ad01cb-b78b-5f5e-b11d-de81424be4a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 115482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 CRTDI 110KW DSG7 4WD CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 4WD CLEVER',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986104%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Saving data for 1986104: {'auction_closing_time': 1775028600.0, 'created_time': 1774565260.519678, 'last_price_update_time': 1774651885.147692}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986104') HTTP/1.1" 204 0
2026-03-27 22:51:25 [ayvens.be] INFO: Found listing with ID: 1986105
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986105%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Scrape type for 1986105: 2
2026-03-27 22:51:25 [ayvens.be] INFO: Extracting data for car ID: 1986105
2026-03-27 22:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-27 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1337cdc-52f0-5c11-b22c-b6e1006cb547 with scrape type 2
2026-03-27 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1337cdc-52f0-5c11-b22c-b6e1006cb547 with scrape type 2
2026-03-27 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1337cdc-52f0-5c11-b22c-b6e1006cb547, identifier: 1986105
2026-03-27 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-27 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-27 22:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105 to the API
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c1337cdc-52f0-5c11-b22c-b6e1006cb547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 40652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986105%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Saving data for 1986105: {'auction_closing_time': 1775028600.0, 'created_time': 1774565274.26765, 'last_price_update_time': 1774651885.518661}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986105') HTTP/1.1" 204 0
2026-03-27 22:51:25 [ayvens.be] INFO: Found listing with ID: 1986106
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986106%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Scrape type for 1986106: 2
2026-03-27 22:51:25 [ayvens.be] INFO: Extracting data for car ID: 1986106
2026-03-27 22:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-27 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with scrape type 2
2026-03-27 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with scrape type 2
2026-03-27 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd, identifier: 1986106
2026-03-27 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-27 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-27 22:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106 to the API
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 207402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 CRTDI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986106%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Saving data for 1986106: {'auction_closing_time': 1775028600.0, 'created_time': 1774565271.964456, 'last_price_update_time': 1774651885.892656}
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986106') HTTP/1.1" 204 0
2026-03-27 22:51:25 [ayvens.be] INFO: Found listing with ID: 1986107
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986107%27 HTTP/1.1" 200 None
2026-03-27 22:51:25 [ayvens.be] INFO: Scrape type for 1986107: 2
2026-03-27 22:51:25 [ayvens.be] INFO: Extracting data for car ID: 1986107
2026-03-27 22:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-27 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044d959a-eef7-583f-bf76-18ca8f11cefa with scrape type 2
2026-03-27 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 044d959a-eef7-583f-bf76-18ca8f11cefa with scrape type 2
2026-03-27 22:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 044d959a-eef7-583f-bf76-18ca8f11cefa, identifier: 1986107
2026-03-27 22:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-27 22:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-27 22:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107 to the API
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '044d959a-eef7-583f-bf76-18ca8f11cefa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 86950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDI PHEV PULSE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV PULSE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986107%27 HTTP/1.1" 200 None
2026-03-27 22:51:26 [ayvens.be] INFO: Saving data for 1986107: {'auction_closing_time': 1775028600.0, 'created_time': 1774565264.095872, 'last_price_update_time': 1774651886.317509}
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986107') HTTP/1.1" 204 0
2026-03-27 22:51:26 [ayvens.be] INFO: Found listing with ID: 1986108
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986108%27 HTTP/1.1" 200 None
2026-03-27 22:51:26 [ayvens.be] INFO: Scrape type for 1986108: 2
2026-03-27 22:51:26 [ayvens.be] INFO: Extracting data for car ID: 1986108
2026-03-27 22:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-27 22:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c69b35c-520e-512b-907d-80a9f87c56ee with scrape type 2
2026-03-27 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c69b35c-520e-512b-907d-80a9f87c56ee with scrape type 2
2026-03-27 22:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c69b35c-520e-512b-907d-80a9f87c56ee, identifier: 1986108
2026-03-27 22:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-27 22:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-27 22:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108 to the API
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2c69b35c-520e-512b-907d-80a9f87c56ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 76510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986108%27 HTTP/1.1" 200 None
2026-03-27 22:51:26 [ayvens.be] INFO: Saving data for 1986108: {'auction_closing_time': 1775028600.0, 'created_time': 1774565269.862624, 'last_price_update_time': 1774651886.776195}
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986108') HTTP/1.1" 204 0
2026-03-27 22:51:26 [ayvens.be] INFO: Found listing with ID: 1986109
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986109%27 HTTP/1.1" 200 None
2026-03-27 22:51:26 [ayvens.be] INFO: Scrape type for 1986109: 2
2026-03-27 22:51:26 [ayvens.be] INFO: Extracting data for car ID: 1986109
2026-03-27 22:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-27 22:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200aebf9-af41-5b65-8832-43f5d7dfd460 with scrape type 2
2026-03-27 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200aebf9-af41-5b65-8832-43f5d7dfd460 with scrape type 2
2026-03-27 22:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 200aebf9-af41-5b65-8832-43f5d7dfd460, identifier: 1986109
2026-03-27 22:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-27 22:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-27 22:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109 to the API
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '200aebf9-af41-5b65-8832-43f5d7dfd460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL - 2020',
 'odometer': 195310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA DIESEL - 2020 2.0 CR TDi EVO Ambition DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi EVO Ambition DSG',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986109%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Saving data for 1986109: {'auction_closing_time': 1775028600.0, 'created_time': 1774565268.697338, 'last_price_update_time': 1774651887.174521}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986109') HTTP/1.1" 204 0
2026-03-27 22:51:27 [ayvens.be] INFO: Found listing with ID: 1986110
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986110%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Scrape type for 1986110: 2
2026-03-27 22:51:27 [ayvens.be] INFO: Extracting data for car ID: 1986110
2026-03-27 22:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-27 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101d4a91-593b-5171-a207-9f994ad6bf13 with scrape type 2
2026-03-27 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 101d4a91-593b-5171-a207-9f994ad6bf13 with scrape type 2
2026-03-27 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 101d4a91-593b-5171-a207-9f994ad6bf13, identifier: 1986110
2026-03-27 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-27 22:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-27 22:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110 to the API
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '101d4a91-593b-5171-a207-9f994ad6bf13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 54907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986110%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Saving data for 1986110: {'auction_closing_time': 1775028600.0, 'created_time': 1774565267.52955, 'last_price_update_time': 1774651887.59736}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986110') HTTP/1.1" 204 0
2026-03-27 22:51:27 [ayvens.be] INFO: Found listing with ID: 1986111
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986111%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Scrape type for 1986111: 2
2026-03-27 22:51:27 [ayvens.be] INFO: Extracting data for car ID: 1986111
2026-03-27 22:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-27 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b6522c-3b16-5915-8240-889381cbcf12 with scrape type 2
2026-03-27 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b6522c-3b16-5915-8240-889381cbcf12 with scrape type 2
2026-03-27 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38b6522c-3b16-5915-8240-889381cbcf12, identifier: 1986111
2026-03-27 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-27 22:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-27 22:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111 to the API
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '38b6522c-3b16-5915-8240-889381cbcf12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 103372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran 2.0 TDI 90KW TRENDLINE',
 'transmission': 'manual',
 'trim': '2.0 TDI 90KW TRENDLINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986111%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Saving data for 1986111: {'auction_closing_time': 1775028600.0, 'created_time': 1774565271.167112, 'last_price_update_time': 1774651887.960683}
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986111') HTTP/1.1" 204 0
2026-03-27 22:51:27 [ayvens.be] INFO: Found listing with ID: 1986112
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986112%27 HTTP/1.1" 200 None
2026-03-27 22:51:27 [ayvens.be] INFO: Scrape type for 1986112: 2
2026-03-27 22:51:27 [ayvens.be] INFO: Extracting data for car ID: 1986112
2026-03-27 22:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-27 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with scrape type 2
2026-03-27 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with scrape type 2
2026-03-27 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1b696bd-cdc7-5c8f-a787-cc9fb6644017, identifier: 1986112
2026-03-27 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-27 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-27 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112 to the API
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e1b696bd-cdc7-5c8f-a787-cc9fb6644017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 54455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986112%27 HTTP/1.1" 200 None
2026-03-27 22:51:28 [ayvens.be] INFO: Saving data for 1986112: {'auction_closing_time': 1775028600.0, 'created_time': 1774565272.632131, 'last_price_update_time': 1774651888.331648}
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986112') HTTP/1.1" 204 0
2026-03-27 22:51:28 [ayvens.be] INFO: Found listing with ID: 1986113
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986113%27 HTTP/1.1" 200 None
2026-03-27 22:51:28 [ayvens.be] INFO: Scrape type for 1986113: 2
2026-03-27 22:51:28 [ayvens.be] INFO: Extracting data for car ID: 1986113
2026-03-27 22:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-27 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09e213b-dcb3-5849-8c5a-aff923d9a202 with scrape type 2
2026-03-27 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09e213b-dcb3-5849-8c5a-aff923d9a202 with scrape type 2
2026-03-27 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d09e213b-dcb3-5849-8c5a-aff923d9a202, identifier: 1986113
2026-03-27 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-27 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-27 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113 to the API
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd09e213b-dcb3-5849-8c5a-aff923d9a202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 47774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 T-GDI 245 PHEV STYLE EDITION AT 4WD',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI 245 PHEV STYLE EDITION AT 4WD',
 'vin': None,
 'year': 2024}
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986113%27 HTTP/1.1" 200 None
2026-03-27 22:51:28 [ayvens.be] INFO: Saving data for 1986113: {'auction_closing_time': 1775028600.0, 'created_time': 1774565275.834599, 'last_price_update_time': 1774651888.700575}
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986113') HTTP/1.1" 204 0
2026-03-27 22:51:28 [ayvens.be] INFO: Found listing with ID: 1986114
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986114%27 HTTP/1.1" 200 None
2026-03-27 22:51:28 [ayvens.be] INFO: Scrape type for 1986114: 2
2026-03-27 22:51:28 [ayvens.be] INFO: Extracting data for car ID: 1986114
2026-03-27 22:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-27 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with scrape type 2
2026-03-27 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with scrape type 2
2026-03-27 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8, identifier: 1986114
2026-03-27 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-27 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-27 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114 to the API
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 96788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 S LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 S LINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986114%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Saving data for 1986114: {'auction_closing_time': 1775028600.0, 'created_time': 1774565277.109869, 'last_price_update_time': 1774651889.100334}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986114') HTTP/1.1" 204 0
2026-03-27 22:51:29 [ayvens.be] INFO: Found listing with ID: 1986115
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986115%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Scrape type for 1986115: 2
2026-03-27 22:51:29 [ayvens.be] INFO: Extracting data for car ID: 1986115
2026-03-27 22:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-27 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3, identifier: 1986115
2026-03-27 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-27 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-27 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115 to the API
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 106114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TGI 96KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.5 TGI 96KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986115%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Saving data for 1986115: {'auction_closing_time': 1775028600.0, 'created_time': 1774565279.733715, 'last_price_update_time': 1774651889.490764}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986115') HTTP/1.1" 204 0
2026-03-27 22:51:29 [ayvens.be] INFO: Found listing with ID: 1986116
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986116%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Scrape type for 1986116: 2
2026-03-27 22:51:29 [ayvens.be] INFO: Extracting data for car ID: 1986116
2026-03-27 22:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-27 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd05defc-932e-5f41-9fe2-636638421e1a with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd05defc-932e-5f41-9fe2-636638421e1a with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd05defc-932e-5f41-9fe2-636638421e1a, identifier: 1986116
2026-03-27 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-27 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-27 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116 to the API
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'bd05defc-932e-5f41-9fe2-636638421e1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 146140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986116%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Saving data for 1986116: {'auction_closing_time': 1775028600.0, 'created_time': 1774565282.322426, 'last_price_update_time': 1774651889.857837}
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986116') HTTP/1.1" 204 0
2026-03-27 22:51:29 [ayvens.be] INFO: Found listing with ID: 1986117
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986117%27 HTTP/1.1" 200 None
2026-03-27 22:51:29 [ayvens.be] INFO: Scrape type for 1986117: 2
2026-03-27 22:51:29 [ayvens.be] INFO: Extracting data for car ID: 1986117
2026-03-27 22:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-27 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796264d2-ef71-5414-ba30-f0650c221ace with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 796264d2-ef71-5414-ba30-f0650c221ace with scrape type 2
2026-03-27 22:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 796264d2-ef71-5414-ba30-f0650c221ace, identifier: 1986117
2026-03-27 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-27 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-27 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117 to the API
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '796264d2-ef71-5414-ba30-f0650c221ace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 87698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA 1.3 GLA 250 E DCT AMG LINE',
 'transmission': 'automatic',
 'trim': '1.3 GLA 250 E DCT AMG LINE',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986117%27 HTTP/1.1" 200 None
2026-03-27 22:51:30 [ayvens.be] INFO: Saving data for 1986117: {'auction_closing_time': 1775028600.0, 'created_time': 1774565282.673191, 'last_price_update_time': 1774651890.235226}
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986117') HTTP/1.1" 204 0
2026-03-27 22:51:30 [ayvens.be] INFO: Found listing with ID: 1986118
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986118%27 HTTP/1.1" 200 None
2026-03-27 22:51:30 [ayvens.be] INFO: Scrape type for 1986118: 2
2026-03-27 22:51:30 [ayvens.be] INFO: Extracting data for car ID: 1986118
2026-03-27 22:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-27 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0876d05a-e310-51a9-871a-8c4c4e06706d with scrape type 2
2026-03-27 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0876d05a-e310-51a9-871a-8c4c4e06706d with scrape type 2
2026-03-27 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0876d05a-e310-51a9-871a-8c4c4e06706d, identifier: 1986118
2026-03-27 22:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-27 22:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-27 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118 to the API
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0876d05a-e310-51a9-871a-8c4c4e06706d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 66102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS 1.5 DCI BLUE 75 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 DCI BLUE 75 CONFORT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986118%27 HTTP/1.1" 200 None
2026-03-27 22:51:30 [ayvens.be] INFO: Saving data for 1986118: {'auction_closing_time': 1775028600.0, 'created_time': 1774565283.687203, 'last_price_update_time': 1774651890.607124}
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986118') HTTP/1.1" 204 0
2026-03-27 22:51:30 [ayvens.be] INFO: Found listing with ID: 1986119
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986119%27 HTTP/1.1" 200 None
2026-03-27 22:51:30 [ayvens.be] INFO: Scrape type for 1986119: 2
2026-03-27 22:51:30 [ayvens.be] INFO: Extracting data for car ID: 1986119
2026-03-27 22:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-27 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83682af-c1d5-556f-98a5-e781e5a0138b with scrape type 2
2026-03-27 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e83682af-c1d5-556f-98a5-e781e5a0138b with scrape type 2
2026-03-27 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e83682af-c1d5-556f-98a5-e781e5a0138b, identifier: 1986119
2026-03-27 22:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-27 22:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-27 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119 to the API
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e83682af-c1d5-556f-98a5-e781e5a0138b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 153859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986119%27 HTTP/1.1" 200 None
2026-03-27 22:51:31 [ayvens.be] INFO: Saving data for 1986119: {'auction_closing_time': 1775028600.0, 'created_time': 1774565286.139477, 'last_price_update_time': 1774651891.328667}
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986119') HTTP/1.1" 204 0
2026-03-27 22:51:31 [ayvens.be] INFO: Found listing with ID: 1986120
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986120%27 HTTP/1.1" 200 None
2026-03-27 22:51:31 [ayvens.be] INFO: Scrape type for 1986120: 2
2026-03-27 22:51:31 [ayvens.be] INFO: Extracting data for car ID: 1986120
2026-03-27 22:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-27 22:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d305006-0852-5850-8020-cc419dbd9f86 with scrape type 2
2026-03-27 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d305006-0852-5850-8020-cc419dbd9f86 with scrape type 2
2026-03-27 22:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d305006-0852-5850-8020-cc419dbd9f86, identifier: 1986120
2026-03-27 22:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-27 22:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-27 22:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120 to the API
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2d305006-0852-5850-8020-cc419dbd9f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 89229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS ED ATTR',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS ED ATTR',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986120%27 HTTP/1.1" 200 None
2026-03-27 22:51:31 [ayvens.be] INFO: Saving data for 1986120: {'auction_closing_time': 1775028600.0, 'created_time': 1774565287.523679, 'last_price_update_time': 1774651891.755263}
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986120') HTTP/1.1" 204 0
2026-03-27 22:51:31 [ayvens.be] INFO: Found listing with ID: 1986121
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986121%27 HTTP/1.1" 200 None
2026-03-27 22:51:31 [ayvens.be] INFO: Scrape type for 1986121: 2
2026-03-27 22:51:31 [ayvens.be] INFO: Extracting data for car ID: 1986121
2026-03-27 22:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-27 22:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c962d856-a1e1-5c8f-bee9-de129749fcf4 with scrape type 2
2026-03-27 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c962d856-a1e1-5c8f-bee9-de129749fcf4 with scrape type 2
2026-03-27 22:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c962d856-a1e1-5c8f-bee9-de129749fcf4, identifier: 1986121
2026-03-27 22:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-27 22:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-27 22:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121 to the API
2026-03-27 22:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c962d856-a1e1-5c8f-bee9-de129749fcf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 127822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986121%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Saving data for 1986121: {'auction_closing_time': 1775028600.0, 'created_time': 1774565289.581252, 'last_price_update_time': 1774651892.152212}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986121') HTTP/1.1" 204 0
2026-03-27 22:51:32 [ayvens.be] INFO: Found listing with ID: 1986122
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986122%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Scrape type for 1986122: 2
2026-03-27 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1986122
2026-03-27 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-27 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e36f3-99cf-5de1-97ea-022894fd7d70 with scrape type 2
2026-03-27 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23e36f3-99cf-5de1-97ea-022894fd7d70 with scrape type 2
2026-03-27 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f23e36f3-99cf-5de1-97ea-022894fd7d70, identifier: 1986122
2026-03-27 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-27 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-27 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122 to the API
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f23e36f3-99cf-5de1-97ea-022894fd7d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 144677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 170KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986122%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Saving data for 1986122: {'auction_closing_time': 1775028600.0, 'created_time': 1774565290.957745, 'last_price_update_time': 1774651892.542482}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986122') HTTP/1.1" 204 0
2026-03-27 22:51:32 [ayvens.be] INFO: Found listing with ID: 1986123
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986123%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Scrape type for 1986123: 2
2026-03-27 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1986123
2026-03-27 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-27 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with scrape type 2
2026-03-27 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with scrape type 2
2026-03-27 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d, identifier: 1986123
2026-03-27 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-27 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-27 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123 to the API
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c5aced6b-d46f-5dc2-a6cd-9bb903a1397d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS CROSS',
 'odometer': 69353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS CROSS 1.5 VVT-IE HEV DYNAMIC PLUS CVT',
 'transmission': 'automatic',
 'trim': '1.5 VVT-IE HEV DYNAMIC PLUS CVT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986123%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Saving data for 1986123: {'auction_closing_time': 1775028600.0, 'created_time': 1774565293.135142, 'last_price_update_time': 1774651892.925744}
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986123') HTTP/1.1" 204 0
2026-03-27 22:51:32 [ayvens.be] INFO: Found listing with ID: 1986124
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986124%27 HTTP/1.1" 200 None
2026-03-27 22:51:32 [ayvens.be] INFO: Scrape type for 1986124: 2
2026-03-27 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1986124
2026-03-27 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-27 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with scrape type 2
2026-03-27 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with scrape type 2
2026-03-27 22:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5, identifier: 1986124
2026-03-27 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-27 22:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-27 22:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124 to the API
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e8a013bd-22c1-5c6d-bce6-42fd909ba0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 26637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 BEV 51KWH ELECTRIQUE E-308 AUTO GT',
 'transmission': 'automatic',
 'trim': 'BEV 51KWH ELECTRIQUE E-308 AUTO GT',
 'vin': None,
 'year': 2024}
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986124%27 HTTP/1.1" 200 None
2026-03-27 22:51:33 [ayvens.be] INFO: Saving data for 1986124: {'auction_closing_time': 1775028600.0, 'created_time': 1774565294.234558, 'last_price_update_time': 1774651893.301922}
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986124') HTTP/1.1" 204 0
2026-03-27 22:51:33 [ayvens.be] INFO: Found listing with ID: 1986125
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986125%27 HTTP/1.1" 200 None
2026-03-27 22:51:33 [ayvens.be] INFO: Scrape type for 1986125: 2
2026-03-27 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1986125
2026-03-27 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-27 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627821ca-29b1-5fd9-bb5c-154f2a67d644 with scrape type 2
2026-03-27 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627821ca-29b1-5fd9-bb5c-154f2a67d644 with scrape type 2
2026-03-27 22:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 627821ca-29b1-5fd9-bb5c-154f2a67d644, identifier: 1986125
2026-03-27 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-27 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-27 22:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125 to the API
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'PEARL WHITE MULTI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '627821ca-29b1-5fd9-bb5c-154f2a67d644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 89447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986125%27 HTTP/1.1" 200 None
2026-03-27 22:51:33 [ayvens.be] INFO: Saving data for 1986125: {'auction_closing_time': 1775028600.0, 'created_time': 1774565294.975803, 'last_price_update_time': 1774651893.689718}
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986125') HTTP/1.1" 204 0
2026-03-27 22:51:33 [ayvens.be] INFO: Found listing with ID: 1986126
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986126%27 HTTP/1.1" 200 None
2026-03-27 22:51:33 [ayvens.be] INFO: Scrape type for 1986126: 2
2026-03-27 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1986126
2026-03-27 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-27 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58a0a4-49a0-521b-ae92-ee9919a76463 with scrape type 2
2026-03-27 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a58a0a4-49a0-521b-ae92-ee9919a76463 with scrape type 2
2026-03-27 22:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a58a0a4-49a0-521b-ae92-ee9919a76463, identifier: 1986126
2026-03-27 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-27 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-27 22:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126 to the API
2026-03-27 22:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'AGATE BLACK MICA',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9a58a0a4-49a0-521b-ae92-ee9919a76463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 173518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 6,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 170PS LIMITED FWD 320 DC LWB AUTO',
 'transmission': 'automatic',
 'trim': '2.0TD 170PS LIMITED FWD 320 DC LWB AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986126%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Saving data for 1986126: {'auction_closing_time': 1775028600.0, 'created_time': 1774565297.12054, 'last_price_update_time': 1774651894.155157}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986126') HTTP/1.1" 204 0
2026-03-27 22:51:34 [ayvens.be] INFO: Found listing with ID: 1986127
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986127%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Scrape type for 1986127: 2
2026-03-27 22:51:34 [ayvens.be] INFO: Extracting data for car ID: 1986127
2026-03-27 22:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-27 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d89dd-63fb-5dfb-8528-680fc89783a4 with scrape type 2
2026-03-27 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee0d89dd-63fb-5dfb-8528-680fc89783a4 with scrape type 2
2026-03-27 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee0d89dd-63fb-5dfb-8528-680fc89783a4, identifier: 1986127
2026-03-27 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-27 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-27 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127 to the API
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'FROZEN WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ee0d89dd-63fb-5dfb-8528-680fc89783a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HR DSL',
 'odometer': 90411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HR DSL 2.0 TDCi L3H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L3H2 Trend STOCK',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986127%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Saving data for 1986127: {'auction_closing_time': 1775028600.0, 'created_time': 1774565298.625847, 'last_price_update_time': 1774651894.542724}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986127') HTTP/1.1" 204 0
2026-03-27 22:51:34 [ayvens.be] INFO: Found listing with ID: 1986128
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986128%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Scrape type for 1986128: 2
2026-03-27 22:51:34 [ayvens.be] INFO: Extracting data for car ID: 1986128
2026-03-27 22:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-27 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c954d54d-3795-5008-8a99-2f623d405a16 with scrape type 2
2026-03-27 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c954d54d-3795-5008-8a99-2f623d405a16 with scrape type 2
2026-03-27 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c954d54d-3795-5008-8a99-2f623d405a16, identifier: 1986128
2026-03-27 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-27 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-27 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128 to the API
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'ARTIC WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c954d54d-3795-5008-8a99-2f623d405a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 220790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 120KW 516 L3 DC AUTO 3.5T',
 'transmission': 'automatic',
 'trim': '2.1CDI 120KW 516 L3 DC AUTO 3.5T',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986128%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Saving data for 1986128: {'auction_closing_time': 1775028600.0, 'created_time': 1774565300.663053, 'last_price_update_time': 1774651894.932378}
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986128') HTTP/1.1" 204 0
2026-03-27 22:51:34 [ayvens.be] INFO: Found listing with ID: 1986129
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986129%27 HTTP/1.1" 200 None
2026-03-27 22:51:34 [ayvens.be] INFO: Scrape type for 1986129: 2
2026-03-27 22:51:34 [ayvens.be] INFO: Extracting data for car ID: 1986129
2026-03-27 22:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-27 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with scrape type 2
2026-03-27 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with scrape type 2
2026-03-27 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021, identifier: 1986129
2026-03-27 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-27 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-27 22:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129 to the API
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '61d6703d-3f5e-5bb0-880a-7bf9c26dd021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 LWB DSL - 2014',
 'odometer': 78351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 LWB DSL - 2014 2.3 dCi 35 L3H1 Energy Twin Turbo '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H1 Energy Twin Turbo STOCK',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986129%27 HTTP/1.1" 200 None
2026-03-27 22:51:35 [ayvens.be] INFO: Saving data for 1986129: {'auction_closing_time': 1775028600.0, 'created_time': 1774565303.422766, 'last_price_update_time': 1774651895.362435}
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986129') HTTP/1.1" 204 0
2026-03-27 22:51:35 [ayvens.be] INFO: Found listing with ID: 1986130
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986130%27 HTTP/1.1" 200 None
2026-03-27 22:51:35 [ayvens.be] INFO: Scrape type for 1986130: 2
2026-03-27 22:51:35 [ayvens.be] INFO: Extracting data for car ID: 1986130
2026-03-27 22:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-27 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b22174-318f-5ff5-ae07-aaad5522ce26 with scrape type 2
2026-03-27 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36b22174-318f-5ff5-ae07-aaad5522ce26 with scrape type 2
2026-03-27 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36b22174-318f-5ff5-ae07-aaad5522ce26, identifier: 1986130
2026-03-27 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-27 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-27 22:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130 to the API
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAVILE GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '36b22174-318f-5ff5-ae07-aaad5522ce26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 - 2016',
 'odometer': 123931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 - 2016 2.0 T8 TE AWD PHEV Inscrip. Ge.(EU6d-T.) STOCK',
 'transmission': 'automatic',
 'trim': '2.0 T8 TE AWD PHEV Inscrip. Ge.(EU6d-T.) STOCK',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986130%27 HTTP/1.1" 200 None
2026-03-27 22:51:35 [ayvens.be] INFO: Saving data for 1986130: {'auction_closing_time': 1775028600.0, 'created_time': 1774565305.053076, 'last_price_update_time': 1774651895.849374}
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986130') HTTP/1.1" 204 0
2026-03-27 22:51:35 [ayvens.be] INFO: Found listing with ID: 1986131
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986131%27 HTTP/1.1" 200 None
2026-03-27 22:51:35 [ayvens.be] INFO: Scrape type for 1986131: 2
2026-03-27 22:51:35 [ayvens.be] INFO: Extracting data for car ID: 1986131
2026-03-27 22:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-27 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with scrape type 2
2026-03-27 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with scrape type 2
2026-03-27 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb, identifier: 1986131
2026-03-27 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-27 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-27 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131 to the API
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '271890e8-17ea-5c62-a5dc-2d293ad8ffeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2013',
 'odometer': 195815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2013 2.8 D-4D Active Van',
 'transmission': 'manual',
 'trim': '2.8 D-4D Active Van',
 'vin': None,
 'year': 2018}
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986131%27 HTTP/1.1" 200 None
2026-03-27 22:51:36 [ayvens.be] INFO: Saving data for 1986131: {'auction_closing_time': 1775028600.0, 'created_time': 1774565306.517604, 'last_price_update_time': 1774651896.244283}
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986131') HTTP/1.1" 204 0
2026-03-27 22:51:36 [ayvens.be] INFO: Found listing with ID: 1986132
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986132%27 HTTP/1.1" 200 None
2026-03-27 22:51:36 [ayvens.be] INFO: Scrape type for 1986132: 2
2026-03-27 22:51:36 [ayvens.be] INFO: Extracting data for car ID: 1986132
2026-03-27 22:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-27 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b with scrape type 2
2026-03-27 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b with scrape type 2
2026-03-27 22:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb8dcd5c-2ea5-528d-ab64-790d668bac9b, identifier: 1986132
2026-03-27 22:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-27 22:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-27 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132 to the API
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'eb8dcd5c-2ea5-528d-ab64-790d668bac9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA 5D',
 'odometer': 29944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 5D 1.0 TSI 70KW S-S STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW S-S STYLE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986132%27 HTTP/1.1" 200 None
2026-03-27 22:51:36 [ayvens.be] INFO: Saving data for 1986132: {'auction_closing_time': 1775028600.0, 'created_time': 1774565308.366409, 'last_price_update_time': 1774651896.623867}
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986132') HTTP/1.1" 204 0
2026-03-27 22:51:36 [ayvens.be] INFO: Found listing with ID: 1986133
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986133%27 HTTP/1.1" 200 None
2026-03-27 22:51:36 [ayvens.be] INFO: Scrape type for 1986133: 2
2026-03-27 22:51:36 [ayvens.be] INFO: Extracting data for car ID: 1986133
2026-03-27 22:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-27 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a with scrape type 2
2026-03-27 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a with scrape type 2
2026-03-27 22:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e533decd-6a4b-5ad4-9de8-abc906ee4a8a, identifier: 1986133
2026-03-27 22:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-27 22:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-27 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133 to the API
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e533decd-6a4b-5ad4-9de8-abc906ee4a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master',
 'odometer': 131976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master 2.3 DCI 135 BLUE G CONFORT L1H1 33',
 'transmission': 'manual',
 'trim': '2.3 DCI 135 BLUE G CONFORT L1H1 33',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986133%27 HTTP/1.1" 200 None
2026-03-27 22:51:36 [ayvens.be] INFO: Saving data for 1986133: {'auction_closing_time': 1775028600.0, 'created_time': 1774565310.639666, 'last_price_update_time': 1774651896.993474}
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986133') HTTP/1.1" 204 0
2026-03-27 22:51:37 [ayvens.be] INFO: Found listing with ID: 1986134
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986134%27 HTTP/1.1" 200 None
2026-03-27 22:51:37 [ayvens.be] INFO: Scrape type for 1986134: 2
2026-03-27 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1986134
2026-03-27 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-27 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddff47d6-5050-544d-ad30-948e8dfbc96a with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddff47d6-5050-544d-ad30-948e8dfbc96a with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddff47d6-5050-544d-ad30-948e8dfbc96a, identifier: 1986134
2026-03-27 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-27 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-27 22:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134 to the API
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ddff47d6-5050-544d-ad30-948e8dfbc96a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 134297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986134%27 HTTP/1.1" 200 None
2026-03-27 22:51:37 [ayvens.be] INFO: Saving data for 1986134: {'auction_closing_time': 1775028600.0, 'created_time': 1774565311.938708, 'last_price_update_time': 1774651897.365567}
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986134') HTTP/1.1" 204 0
2026-03-27 22:51:37 [ayvens.be] INFO: Found listing with ID: 1986135
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986135%27 HTTP/1.1" 200 None
2026-03-27 22:51:37 [ayvens.be] INFO: Scrape type for 1986135: 2
2026-03-27 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1986135
2026-03-27 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-27 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d0061d6-9db7-5a3a-8d11-0e874fdca899, identifier: 1986135
2026-03-27 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-27 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-27 22:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135 to the API
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d0061d6-9db7-5a3a-8d11-0e874fdca899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 26773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS LIMITED EDITION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS LIMITED EDITION AUTO',
 'vin': None,
 'year': 2024}
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986135%27 HTTP/1.1" 200 None
2026-03-27 22:51:37 [ayvens.be] INFO: Saving data for 1986135: {'auction_closing_time': 1775028600.0, 'created_time': 1774565313.661698, 'last_price_update_time': 1774651897.744086}
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986135') HTTP/1.1" 204 0
2026-03-27 22:51:37 [ayvens.be] INFO: Found listing with ID: 1986136
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986136%27 HTTP/1.1" 200 None
2026-03-27 22:51:37 [ayvens.be] INFO: Scrape type for 1986136: 2
2026-03-27 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1986136
2026-03-27 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-27 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c1c752-3a76-5b5d-a2bb-987e8e789495 with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c1c752-3a76-5b5d-a2bb-987e8e789495 with scrape type 2
2026-03-27 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96c1c752-3a76-5b5d-a2bb-987e8e789495, identifier: 1986136
2026-03-27 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-27 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-27 22:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136 to the API
2026-03-27 22:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '96c1c752-3a76-5b5d-a2bb-987e8e789495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 103732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW S TRONIC S LINE BUS. ED',
 'transmission': 'automatic',
 'trim': '1.0 30 TFSI 81KW S TRONIC S LINE BUS. ED',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986136%27 HTTP/1.1" 200 None
2026-03-27 22:51:38 [ayvens.be] INFO: Saving data for 1986136: {'auction_closing_time': 1775028600.0, 'created_time': 1774565315.218728, 'last_price_update_time': 1774651898.124507}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986136') HTTP/1.1" 204 0
2026-03-27 22:51:38 [ayvens.be] INFO: Found listing with ID: 1986137
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986137%27 HTTP/1.1" 200 None
2026-03-27 22:51:38 [ayvens.be] INFO: Scrape type for 1986137: 2
2026-03-27 22:51:38 [ayvens.be] INFO: Extracting data for car ID: 1986137
2026-03-27 22:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-27 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bab4716-979a-5109-af4a-c59a4b3a7c60 with scrape type 2
2026-03-27 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bab4716-979a-5109-af4a-c59a4b3a7c60 with scrape type 2
2026-03-27 22:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9bab4716-979a-5109-af4a-c59a4b3a7c60, identifier: 1986137
2026-03-27 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-27 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-27 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137 to the API
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9bab4716-979a-5109-af4a-c59a4b3a7c60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 120500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986137%27 HTTP/1.1" 200 None
2026-03-27 22:51:38 [ayvens.be] INFO: Saving data for 1986137: {'auction_closing_time': 1775028600.0, 'created_time': 1774565316.673343, 'last_price_update_time': 1774651898.518458}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986137') HTTP/1.1" 204 0
2026-03-27 22:51:38 [ayvens.be] INFO: Found listing with ID: 1986138
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986138%27 HTTP/1.1" 200 None
2026-03-27 22:51:38 [ayvens.be] INFO: Scrape type for 1986138: 2
2026-03-27 22:51:38 [ayvens.be] INFO: Extracting data for car ID: 1986138
2026-03-27 22:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-27 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with scrape type 2
2026-03-27 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with scrape type 2
2026-03-27 22:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c, identifier: 1986138
2026-03-27 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-27 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-27 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138 to the API
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f45ec6cc-abd5-5d95-88a5-82e3ee205a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 44358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986138%27 HTTP/1.1" 200 None
2026-03-27 22:51:38 [ayvens.be] INFO: Saving data for 1986138: {'auction_closing_time': 1775028600.0, 'created_time': 1774565317.83562, 'last_price_update_time': 1774651898.969703}
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986138') HTTP/1.1" 204 0
2026-03-27 22:51:38 [ayvens.be] INFO: Found listing with ID: 1986139
2026-03-27 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986139%27 HTTP/1.1" 200 None
2026-03-27 22:51:39 [ayvens.be] INFO: Scrape type for 1986139: 2
2026-03-27 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1986139
2026-03-27 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-27 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f2381e-79cd-5692-83e0-61e55f83ca28 with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f2381e-79cd-5692-83e0-61e55f83ca28 with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 66f2381e-79cd-5692-83e0-61e55f83ca28, identifier: 1986139
2026-03-27 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-27 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-27 22:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139 to the API
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '66f2381e-79cd-5692-83e0-61e55f83ca28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 53360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986139%27 HTTP/1.1" 200 None
2026-03-27 22:51:39 [ayvens.be] INFO: Saving data for 1986139: {'auction_closing_time': 1775028600.0, 'created_time': 1774565319.198519, 'last_price_update_time': 1774651899.355703}
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986139') HTTP/1.1" 204 0
2026-03-27 22:51:39 [ayvens.be] INFO: Found listing with ID: 1986140
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986140%27 HTTP/1.1" 200 None
2026-03-27 22:51:39 [ayvens.be] INFO: Scrape type for 1986140: 2
2026-03-27 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1986140
2026-03-27 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-27 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c9015f-5470-5609-9213-15ee159e682e with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1c9015f-5470-5609-9213-15ee159e682e with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1c9015f-5470-5609-9213-15ee159e682e, identifier: 1986140
2026-03-27 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-27 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-27 22:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140 to the API
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd1c9015f-5470-5609-9213-15ee159e682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 142459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 INTENS',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986140%27 HTTP/1.1" 200 None
2026-03-27 22:51:39 [ayvens.be] INFO: Saving data for 1986140: {'auction_closing_time': 1775028600.0, 'created_time': 1774565320.95289, 'last_price_update_time': 1774651899.747234}
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986140') HTTP/1.1" 204 0
2026-03-27 22:51:39 [ayvens.be] INFO: Found listing with ID: 1986141
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986141%27 HTTP/1.1" 200 None
2026-03-27 22:51:39 [ayvens.be] INFO: Scrape type for 1986141: 2
2026-03-27 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1986141
2026-03-27 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-27 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with scrape type 2
2026-03-27 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a, identifier: 1986141
2026-03-27 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-27 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-27 22:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141 to the API
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 87463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T3 R-DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T3 R-DESIGN AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986141%27 HTTP/1.1" 200 None
2026-03-27 22:51:40 [ayvens.be] INFO: Saving data for 1986141: {'auction_closing_time': 1775028600.0, 'created_time': 1774565322.685231, 'last_price_update_time': 1774651900.227538}
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986141') HTTP/1.1" 204 0
2026-03-27 22:51:40 [ayvens.be] INFO: Found listing with ID: 1986142
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986142%27 HTTP/1.1" 200 None
2026-03-27 22:51:40 [ayvens.be] INFO: Scrape type for 1986142: 2
2026-03-27 22:51:40 [ayvens.be] INFO: Extracting data for car ID: 1986142
2026-03-27 22:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-27 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea with scrape type 2
2026-03-27 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea with scrape type 2
2026-03-27 22:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e65c056-1282-55f7-8325-6f8c8c3e02ea, identifier: 1986142
2026-03-27 22:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-27 22:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-27 22:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142 to the API
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5e65c056-1282-55f7-8325-6f8c8c3e02ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 136463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Ambition DSG',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986142%27 HTTP/1.1" 200 None
2026-03-27 22:51:40 [ayvens.be] INFO: Saving data for 1986142: {'auction_closing_time': 1775028600.0, 'created_time': 1774565324.447227, 'last_price_update_time': 1774651900.593449}
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986142') HTTP/1.1" 204 0
2026-03-27 22:51:40 [ayvens.be] INFO: Found listing with ID: 1986143
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986143%27 HTTP/1.1" 200 None
2026-03-27 22:51:40 [ayvens.be] INFO: Scrape type for 1986143: 2
2026-03-27 22:51:40 [ayvens.be] INFO: Extracting data for car ID: 1986143
2026-03-27 22:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-27 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with scrape type 2
2026-03-27 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with scrape type 2
2026-03-27 22:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b7435c1-7f64-5601-9a51-3e9d97336ce1, identifier: 1986143
2026-03-27 22:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-27 22:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-27 22:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143 to the API
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '5b7435c1-7f64-5601-9a51-3e9d97336ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 101961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986143%27 HTTP/1.1" 200 None
2026-03-27 22:51:40 [ayvens.be] INFO: Saving data for 1986143: {'auction_closing_time': 1775028600.0, 'created_time': 1774565325.608648, 'last_price_update_time': 1774651900.993398}
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986143') HTTP/1.1" 204 0
2026-03-27 22:51:41 [ayvens.be] INFO: Found listing with ID: 1986144
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986144%27 HTTP/1.1" 200 None
2026-03-27 22:51:41 [ayvens.be] INFO: Scrape type for 1986144: 2
2026-03-27 22:51:41 [ayvens.be] INFO: Extracting data for car ID: 1986144
2026-03-27 22:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-27 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b834dd5-7b94-506e-b4eb-02906db770f6 with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b834dd5-7b94-506e-b4eb-02906db770f6 with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b834dd5-7b94-506e-b4eb-02906db770f6, identifier: 1986144
2026-03-27 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-27 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-27 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144 to the API
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '3b834dd5-7b94-506e-b4eb-02906db770f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX2',
 'odometer': 17645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX2 BEV 67KWH EDRIVE20 150KW',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW',
 'vin': None,
 'year': 2024}
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986144%27 HTTP/1.1" 200 None
2026-03-27 22:51:41 [ayvens.be] INFO: Saving data for 1986144: {'auction_closing_time': 1775028600.0, 'created_time': 1774565326.683038, 'last_price_update_time': 1774651901.366055}
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986144') HTTP/1.1" 204 0
2026-03-27 22:51:41 [ayvens.be] INFO: Found listing with ID: 1986145
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986145%27 HTTP/1.1" 200 None
2026-03-27 22:51:41 [ayvens.be] INFO: Scrape type for 1986145: 2
2026-03-27 22:51:41 [ayvens.be] INFO: Extracting data for car ID: 1986145
2026-03-27 22:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-27 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf, identifier: 1986145
2026-03-27 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-27 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-27 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145 to the API
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLE DIESEL (W167)',
 'odometer': 140549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLE DIESEL (W167) GLE 350 de 4-Matic PHEV',
 'transmission': 'automatic',
 'trim': 'GLE 350 de 4-Matic PHEV',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986145%27 HTTP/1.1" 200 None
2026-03-27 22:51:41 [ayvens.be] INFO: Saving data for 1986145: {'auction_closing_time': 1775028600.0, 'created_time': 1774565328.465, 'last_price_update_time': 1774651901.740449}
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986145') HTTP/1.1" 204 0
2026-03-27 22:51:41 [ayvens.be] INFO: Found listing with ID: 1986146
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986146%27 HTTP/1.1" 200 None
2026-03-27 22:51:41 [ayvens.be] INFO: Scrape type for 1986146: 2
2026-03-27 22:51:41 [ayvens.be] INFO: Extracting data for car ID: 1986146
2026-03-27 22:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-27 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37d7dba-48b8-5a24-b004-5fc9981c1360 with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37d7dba-48b8-5a24-b004-5fc9981c1360 with scrape type 2
2026-03-27 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e37d7dba-48b8-5a24-b004-5fc9981c1360, identifier: 1986146
2026-03-27 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-27 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-27 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146 to the API
2026-03-27 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e37d7dba-48b8-5a24-b004-5fc9981c1360',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 116277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986146%27 HTTP/1.1" 200 None
2026-03-27 22:51:42 [ayvens.be] INFO: Saving data for 1986146: {'auction_closing_time': 1775028600.0, 'created_time': 1774565330.243157, 'last_price_update_time': 1774651902.128024}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986146') HTTP/1.1" 204 0
2026-03-27 22:51:42 [ayvens.be] INFO: Found listing with ID: 1986147
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986147%27 HTTP/1.1" 200 None
2026-03-27 22:51:42 [ayvens.be] INFO: Scrape type for 1986147: 2
2026-03-27 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1986147
2026-03-27 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-27 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with scrape type 2
2026-03-27 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with scrape type 2
2026-03-27 22:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc55da5f-d10b-5e98-a1c4-ea4db4a25646, identifier: 1986147
2026-03-27 22:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-27 22:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-27 22:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147 to the API
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bc55da5f-d10b-5e98-a1c4-ea4db4a25646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 94319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986147%27 HTTP/1.1" 200 None
2026-03-27 22:51:42 [ayvens.be] INFO: Saving data for 1986147: {'auction_closing_time': 1775028600.0, 'created_time': 1774565331.744738, 'last_price_update_time': 1774651902.585676}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986147') HTTP/1.1" 204 0
2026-03-27 22:51:42 [ayvens.be] INFO: Found listing with ID: 1986148
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986148%27 HTTP/1.1" 200 None
2026-03-27 22:51:42 [ayvens.be] INFO: Scrape type for 1986148: 2
2026-03-27 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1986148
2026-03-27 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-27 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with scrape type 2
2026-03-27 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with scrape type 2
2026-03-27 22:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b, identifier: 1986148
2026-03-27 22:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-27 22:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-27 22:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148 to the API
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '17e5649b-3762-5c55-8cbe-f61d8d3ecd5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 40490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986148%27 HTTP/1.1" 200 None
2026-03-27 22:51:42 [ayvens.be] INFO: Saving data for 1986148: {'auction_closing_time': 1775028600.0, 'created_time': 1774565333.128961, 'last_price_update_time': 1774651902.990808}
2026-03-27 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986148') HTTP/1.1" 204 0
2026-03-27 22:51:43 [ayvens.be] INFO: Found listing with ID: 1986149
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986149%27 HTTP/1.1" 200 None
2026-03-27 22:51:43 [ayvens.be] INFO: Scrape type for 1986149: 2
2026-03-27 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1986149
2026-03-27 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-27 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae, identifier: 1986149
2026-03-27 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-27 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-27 22:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149 to the API
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 150860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 1.5 TSI ACT Comfortline OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Comfortline OPF DSG',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986149%27 HTTP/1.1" 200 None
2026-03-27 22:51:43 [ayvens.be] INFO: Saving data for 1986149: {'auction_closing_time': 1775028600.0, 'created_time': 1774565335.171418, 'last_price_update_time': 1774651903.379028}
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986149') HTTP/1.1" 204 0
2026-03-27 22:51:43 [ayvens.be] INFO: Found listing with ID: 1986150
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986150%27 HTTP/1.1" 200 None
2026-03-27 22:51:43 [ayvens.be] INFO: Scrape type for 1986150: 2
2026-03-27 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1986150
2026-03-27 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-27 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd, identifier: 1986150
2026-03-27 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-27 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-27 22:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150 to the API
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPAu2030',
 'odometer': 96955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPAu2030 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'manual',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986150%27 HTTP/1.1" 200 None
2026-03-27 22:51:43 [ayvens.be] INFO: Saving data for 1986150: {'auction_closing_time': 1775028600.0, 'created_time': 1774565336.242648, 'last_price_update_time': 1774651903.791164}
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986150') HTTP/1.1" 204 0
2026-03-27 22:51:43 [ayvens.be] INFO: Found listing with ID: 1986151
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986151%27 HTTP/1.1" 200 None
2026-03-27 22:51:43 [ayvens.be] INFO: Scrape type for 1986151: 2
2026-03-27 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1986151
2026-03-27 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-27 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5229c5e-a5ef-5efd-b602-a0f989598542 with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5229c5e-a5ef-5efd-b602-a0f989598542 with scrape type 2
2026-03-27 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5229c5e-a5ef-5efd-b602-a0f989598542, identifier: 1986151
2026-03-27 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-27 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-27 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151 to the API
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c5229c5e-a5ef-5efd-b602-a0f989598542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 - 2020',
 'odometer': 125307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 - 2020 2.0 T6 AWD PHEV Inscription Expression G',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Expression G',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986151%27 HTTP/1.1" 200 None
2026-03-27 22:51:44 [ayvens.be] INFO: Saving data for 1986151: {'auction_closing_time': 1775028600.0, 'created_time': 1774565338.538969, 'last_price_update_time': 1774651904.192156}
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986151') HTTP/1.1" 204 0
2026-03-27 22:51:44 [ayvens.be] INFO: Found listing with ID: 1986152
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986152%27 HTTP/1.1" 200 None
2026-03-27 22:51:44 [ayvens.be] INFO: Scrape type for 1986152: 2
2026-03-27 22:51:44 [ayvens.be] INFO: Extracting data for car ID: 1986152
2026-03-27 22:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-27 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with scrape type 2
2026-03-27 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with scrape type 2
2026-03-27 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9, identifier: 1986152
2026-03-27 22:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-27 22:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-27 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152 to the API
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '98b50fbd-2b43-55b4-afb3-d71d9cfc47c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 44498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 50 S LINE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 50 S LINE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986152%27 HTTP/1.1" 200 None
2026-03-27 22:51:44 [ayvens.be] INFO: Saving data for 1986152: {'auction_closing_time': 1775028600.0, 'created_time': 1774565339.899838, 'last_price_update_time': 1774651904.652951}
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986152') HTTP/1.1" 204 0
2026-03-27 22:51:44 [ayvens.be] INFO: Found listing with ID: 1986153
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986153%27 HTTP/1.1" 200 None
2026-03-27 22:51:44 [ayvens.be] INFO: Scrape type for 1986153: 2
2026-03-27 22:51:44 [ayvens.be] INFO: Extracting data for car ID: 1986153
2026-03-27 22:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-27 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ec590c-0586-55a1-90df-b2f32e99d033 with scrape type 2
2026-03-27 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99ec590c-0586-55a1-90df-b2f32e99d033 with scrape type 2
2026-03-27 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99ec590c-0586-55a1-90df-b2f32e99d033, identifier: 1986153
2026-03-27 22:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-27 22:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-27 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153 to the API
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '99ec590c-0586-55a1-90df-b2f32e99d033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 DIESEL - 2018',
 'odometer': 73440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 DIESEL - 2018 2.0 dA sDrive18 AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 dA sDrive18 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986153%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Saving data for 1986153: {'auction_closing_time': 1775028600.0, 'created_time': 1774565341.08939, 'last_price_update_time': 1774651905.073984}
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986153') HTTP/1.1" 204 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983710
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983710%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983710: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983711
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983711%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983711: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983712
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983712%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983712: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983713
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983713%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983713: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983714
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983714%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983714: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983715
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983715%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983715: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983716
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983716%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983716: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983717
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983717%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983717: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983718
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983718%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983718: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983719
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983719%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983719: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983720
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983720%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983720: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983721
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983721%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983721: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983722
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983722%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983722: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983723
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983723%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983723: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983724
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983724%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983724: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983725
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983725%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983725: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983726
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983726%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983726: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983727
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983727%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983727: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Found listing with ID: 1983728
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983728%27 HTTP/1.1" 200 None
2026-03-27 22:51:45 [ayvens.be] INFO: Scrape type for 1983728: 0
2026-03-27 22:51:45 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-27 22:51:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983729
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983729%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983729: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983730
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983730%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983730: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983731
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983731%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983731: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983732
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983732%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983732: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983733
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983733%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983733: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983734
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983734%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983734: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983735
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983735%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983735: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983736
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983736%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983736: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983737
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983737%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983737: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983738
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983738%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983738: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983739
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983739%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983739: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983740
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983740%27 HTTP/1.1" 200 None
2026-03-27 22:51:47 [ayvens.be] INFO: Scrape type for 1983740: 0
2026-03-27 22:51:47 [ayvens.be] INFO: Found listing with ID: 1983741
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983741%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983741: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983742
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983742%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983742: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983743
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983743%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983743: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983744
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983744%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983744: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983745
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983745%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983745: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983746
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983746%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983746: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983747
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983747%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983747: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983748
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983748%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983748: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983749
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983749%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983749: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983750
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983750%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983750: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983751
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983751%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983751: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983752
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983752%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983752: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983753
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983753%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983753: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983754
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983754%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983754: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983755
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983755%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983755: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983756
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983756%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983756: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983757
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983757%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983757: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983758
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983758%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983758: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983759
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983759%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983759: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983760
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983760%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983760: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983761
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983761%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983761: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983762
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983762%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983762: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983763
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983763%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983763: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983764
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983764%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983764: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983765
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983765%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983765: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983766
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983766%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983766: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983767
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983767%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983767: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983768
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983768%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983768: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983769
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983769%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983769: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983770
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983770%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983770: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983771
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983771%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983771: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983772
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983772%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983772: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983773
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983773%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983773: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983774
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983774%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983774: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983775
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983775%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983775: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983776
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983776%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983776: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983777
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983777%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983777: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983778
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983778%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983778: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983779
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983779%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983779: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1983780
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983780%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1983780: 0
2026-03-27 22:51:48 [ayvens.be] INFO: Found listing with ID: 1985345
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985345%27 HTTP/1.1" 200 None
2026-03-27 22:51:48 [ayvens.be] INFO: Scrape type for 1985345: 2
2026-03-27 22:51:48 [ayvens.be] INFO: Extracting data for car ID: 1985345
2026-03-27 22:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-27 22:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 2
2026-03-27 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 2
2026-03-27 22:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 593c4467-f8bf-57aa-b5f8-b38822117ae8, identifier: 1985345
2026-03-27 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-27 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-27 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345 to the API
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'PYRIT SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '593c4467-f8bf-57aa-b5f8-b38822117ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE DIESEL',
 'odometer': 158856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE DIESEL 2.0 TDi SCR Platinum DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR Platinum DSG',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985345%27 HTTP/1.1" 200 None
2026-03-27 22:51:49 [ayvens.be] INFO: Saving data for 1985345: {'auction_closing_time': 1774958400.0, 'created_time': 1774565346.308257, 'last_price_update_time': 1774651909.403774}
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985345') HTTP/1.1" 204 0
2026-03-27 22:51:49 [ayvens.be] INFO: Found listing with ID: 1985346
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985346%27 HTTP/1.1" 200 None
2026-03-27 22:51:49 [ayvens.be] INFO: Scrape type for 1985346: 2
2026-03-27 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1985346
2026-03-27 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-27 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 2
2026-03-27 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 2
2026-03-27 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b, identifier: 1985346
2026-03-27 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-27 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-27 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346 to the API
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI COUNTRYMAN - 2017',
 'odometer': 107928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI COUNTRYMAN - 2017 1.5A Cooper S E ALL4 Plug-In '
          'H.(EU6d-T.)',
 'transmission': 'automatic',
 'trim': '1.5A Cooper S E ALL4 Plug-In H.(EU6d-T.)',
 'vin': None,
 'year': 2019}
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985346%27 HTTP/1.1" 200 None
2026-03-27 22:51:49 [ayvens.be] INFO: Saving data for 1985346: {'auction_closing_time': 1774958400.0, 'created_time': 1774565347.660882, 'last_price_update_time': 1774651909.88401}
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985346') HTTP/1.1" 204 0
2026-03-27 22:51:49 [ayvens.be] INFO: Found listing with ID: 1985347
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985347%27 HTTP/1.1" 200 None
2026-03-27 22:51:49 [ayvens.be] INFO: Scrape type for 1985347: 2
2026-03-27 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1985347
2026-03-27 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-27 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 2
2026-03-27 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 2
2026-03-27 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5, identifier: 1985347
2026-03-27 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-27 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-27 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347 to the API
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 89653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Ultimate',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Ultimate',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985347%27 HTTP/1.1" 200 None
2026-03-27 22:51:50 [ayvens.be] INFO: Saving data for 1985347: {'auction_closing_time': 1774958400.0, 'created_time': 1774565349.634874, 'last_price_update_time': 1774651910.281244}
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985347') HTTP/1.1" 204 0
2026-03-27 22:51:50 [ayvens.be] INFO: Found listing with ID: 1985348
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985348%27 HTTP/1.1" 200 None
2026-03-27 22:51:50 [ayvens.be] INFO: Scrape type for 1985348: 2
2026-03-27 22:51:50 [ayvens.be] INFO: Extracting data for car ID: 1985348
2026-03-27 22:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-27 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 2
2026-03-27 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 2
2026-03-27 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2bb4396-a70a-5221-884b-42a7e82f7a79, identifier: 1985348
2026-03-27 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-27 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-27 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348 to the API
2026-03-27 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2bb4396-a70a-5221-884b-42a7e82f7a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 45610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985348%27 HTTP/1.1" 200 None
2026-03-27 22:51:51 [ayvens.be] INFO: Saving data for 1985348: {'auction_closing_time': 1774958400.0, 'created_time': 1774565351.440176, 'last_price_update_time': 1774651911.379624}
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985348') HTTP/1.1" 204 0
2026-03-27 22:51:51 [ayvens.be] INFO: Found listing with ID: 1985349
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985349%27 HTTP/1.1" 200 None
2026-03-27 22:51:51 [ayvens.be] INFO: Scrape type for 1985349: 2
2026-03-27 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1985349
2026-03-27 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-27 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 2
2026-03-27 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 2
2026-03-27 22:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65, identifier: 1985349
2026-03-27 22:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-27 22:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-27 22:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349 to the API
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 122437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW S LINE',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW S LINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985349%27 HTTP/1.1" 200 None
2026-03-27 22:51:51 [ayvens.be] INFO: Saving data for 1985349: {'auction_closing_time': 1774958400.0, 'created_time': 1774565352.71203, 'last_price_update_time': 1774651911.767321}
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985349') HTTP/1.1" 204 0
2026-03-27 22:51:51 [ayvens.be] INFO: Found listing with ID: 1985350
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985350%27 HTTP/1.1" 200 None
2026-03-27 22:51:51 [ayvens.be] INFO: Scrape type for 1985350: 2
2026-03-27 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1985350
2026-03-27 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-27 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 2
2026-03-27 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 2
2026-03-27 22:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b27c98bc-616f-55c0-892b-d9a4b79cfc05, identifier: 1985350
2026-03-27 22:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-27 22:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-27 22:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350 to the API
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'b27c98bc-616f-55c0-892b-d9a4b79cfc05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 147043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985350%27 HTTP/1.1" 200 None
2026-03-27 22:51:52 [ayvens.be] INFO: Saving data for 1985350: {'auction_closing_time': 1774958400.0, 'created_time': 1774565354.159675, 'last_price_update_time': 1774651912.191075}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985350') HTTP/1.1" 204 0
2026-03-27 22:51:52 [ayvens.be] INFO: Found listing with ID: 1985351
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985351%27 HTTP/1.1" 200 None
2026-03-27 22:51:52 [ayvens.be] INFO: Scrape type for 1985351: 2
2026-03-27 22:51:52 [ayvens.be] INFO: Extracting data for car ID: 1985351
2026-03-27 22:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-27 22:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 2
2026-03-27 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 2
2026-03-27 22:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73, identifier: 1985351
2026-03-27 22:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-27 22:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-27 22:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351 to the API
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a8018b6c-8e7a-55a8-81ec-c9ae9c195f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 116535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985351%27 HTTP/1.1" 200 None
2026-03-27 22:51:52 [ayvens.be] INFO: Saving data for 1985351: {'auction_closing_time': 1774958400.0, 'created_time': 1774565356.662767, 'last_price_update_time': 1774651912.58911}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985351') HTTP/1.1" 204 0
2026-03-27 22:51:52 [ayvens.be] INFO: Found listing with ID: 1985352
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985352%27 HTTP/1.1" 200 None
2026-03-27 22:51:52 [ayvens.be] INFO: Scrape type for 1985352: 2
2026-03-27 22:51:52 [ayvens.be] INFO: Extracting data for car ID: 1985352
2026-03-27 22:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-27 22:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 2
2026-03-27 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 2
2026-03-27 22:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 47ce7439-f723-56a1-9135-28d7ab2700fd, identifier: 1985352
2026-03-27 22:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-27 22:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-27 22:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352 to the API
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '47ce7439-f723-56a1-9135-28d7ab2700fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 59999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985352%27 HTTP/1.1" 200 None
2026-03-27 22:51:52 [ayvens.be] INFO: Saving data for 1985352: {'auction_closing_time': 1774958400.0, 'created_time': 1774565357.333348, 'last_price_update_time': 1774651912.985975}
2026-03-27 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985352') HTTP/1.1" 204 0
2026-03-27 22:51:53 [ayvens.be] INFO: Found listing with ID: 1985353
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985353%27 HTTP/1.1" 200 None
2026-03-27 22:51:53 [ayvens.be] INFO: Scrape type for 1985353: 2
2026-03-27 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1985353
2026-03-27 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-27 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, identifier: 1985353
2026-03-27 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-27 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-27 22:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353 to the API
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '86223df2-a655-5ba1-8ef4-a3eea7e1c134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 214066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985353%27 HTTP/1.1" 200 None
2026-03-27 22:51:53 [ayvens.be] INFO: Saving data for 1985353: {'auction_closing_time': 1774958400.0, 'created_time': 1774565358.86386, 'last_price_update_time': 1774651913.408455}
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985353') HTTP/1.1" 204 0
2026-03-27 22:51:53 [ayvens.be] INFO: Found listing with ID: 1985354
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985354%27 HTTP/1.1" 200 None
2026-03-27 22:51:53 [ayvens.be] INFO: Scrape type for 1985354: 2
2026-03-27 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1985354
2026-03-27 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-27 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, identifier: 1985354
2026-03-27 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-27 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-27 22:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354 to the API
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 87175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'transmission': 'automatic',
 'trim': '1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985354%27 HTTP/1.1" 200 None
2026-03-27 22:51:53 [ayvens.be] INFO: Saving data for 1985354: {'auction_closing_time': 1774958400.0, 'created_time': 1774565360.714588, 'last_price_update_time': 1774651913.807693}
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985354') HTTP/1.1" 204 0
2026-03-27 22:51:53 [ayvens.be] INFO: Found listing with ID: 1985355
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985355%27 HTTP/1.1" 200 None
2026-03-27 22:51:53 [ayvens.be] INFO: Scrape type for 1985355: 2
2026-03-27 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1985355
2026-03-27 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-27 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 2
2026-03-27 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df095015-0ccb-5f99-b189-ce5e41de1ee3, identifier: 1985355
2026-03-27 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-27 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-27 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355 to the API
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df095015-0ccb-5f99-b189-ce5e41de1ee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 92656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985355%27 HTTP/1.1" 200 None
2026-03-27 22:51:54 [ayvens.be] INFO: Saving data for 1985355: {'auction_closing_time': 1774958400.0, 'created_time': 1774565362.221628, 'last_price_update_time': 1774651914.219165}
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985355') HTTP/1.1" 204 0
2026-03-27 22:51:54 [ayvens.be] INFO: Found listing with ID: 1985356
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985356%27 HTTP/1.1" 200 None
2026-03-27 22:51:54 [ayvens.be] INFO: Scrape type for 1985356: 2
2026-03-27 22:51:54 [ayvens.be] INFO: Extracting data for car ID: 1985356
2026-03-27 22:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-27 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 2
2026-03-27 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 2
2026-03-27 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, identifier: 1985356
2026-03-27 22:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-27 22:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-27 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356 to the API
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ceb1d629-df7b-58ce-aa91-9dee573cbb0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 82333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985356%27 HTTP/1.1" 200 None
2026-03-27 22:51:54 [ayvens.be] INFO: Saving data for 1985356: {'auction_closing_time': 1774958400.0, 'created_time': 1774565364.541285, 'last_price_update_time': 1774651914.620936}
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985356') HTTP/1.1" 204 0
2026-03-27 22:51:54 [ayvens.be] INFO: Found listing with ID: 1985357
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985357%27 HTTP/1.1" 200 None
2026-03-27 22:51:54 [ayvens.be] INFO: Scrape type for 1985357: 2
2026-03-27 22:51:54 [ayvens.be] INFO: Extracting data for car ID: 1985357
2026-03-27 22:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-27 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 2
2026-03-27 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 2
2026-03-27 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, identifier: 1985357
2026-03-27 22:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-27 22:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-27 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357 to the API
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd509a2bd-3224-5aa1-a4e3-43f55bb7adc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 150951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985357%27 HTTP/1.1" 200 None
2026-03-27 22:51:55 [ayvens.be] INFO: Saving data for 1985357: {'auction_closing_time': 1774958400.0, 'created_time': 1774565366.031621, 'last_price_update_time': 1774651915.195768}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985357') HTTP/1.1" 204 0
2026-03-27 22:51:55 [ayvens.be] INFO: Found listing with ID: 1985358
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985358%27 HTTP/1.1" 200 None
2026-03-27 22:51:55 [ayvens.be] INFO: Scrape type for 1985358: 2
2026-03-27 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1985358
2026-03-27 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-27 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 2
2026-03-27 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 2
2026-03-27 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1, identifier: 1985358
2026-03-27 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-27 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-27 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358 to the API
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '183a01eb-ba00-5b6a-8f49-a0247b53e1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 76834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985358%27 HTTP/1.1" 200 None
2026-03-27 22:51:55 [ayvens.be] INFO: Saving data for 1985358: {'auction_closing_time': 1774958400.0, 'created_time': 1774565368.755878, 'last_price_update_time': 1774651915.58897}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985358') HTTP/1.1" 204 0
2026-03-27 22:51:55 [ayvens.be] INFO: Found listing with ID: 1985359
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985359%27 HTTP/1.1" 200 None
2026-03-27 22:51:55 [ayvens.be] INFO: Scrape type for 1985359: 2
2026-03-27 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1985359
2026-03-27 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-27 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 2
2026-03-27 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 2
2026-03-27 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8, identifier: 1985359
2026-03-27 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-27 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-27 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359 to the API
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5f974a-0766-52a4-afdb-ae60ea21c7a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'LEON ST',
 'odometer': 97512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA LEON ST 1.4 PHEV E-HYBRID 150KW DSG SP',
 'transmission': 'automatic',
 'trim': '1.4 PHEV E-HYBRID 150KW DSG SP',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985359%27 HTTP/1.1" 200 None
2026-03-27 22:51:55 [ayvens.be] INFO: Saving data for 1985359: {'auction_closing_time': 1774958400.0, 'created_time': 1774565370.180377, 'last_price_update_time': 1774651915.9723}
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985359') HTTP/1.1" 204 0
2026-03-27 22:51:55 [ayvens.be] INFO: Found listing with ID: 1985360
2026-03-27 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985360%27 HTTP/1.1" 200 None
2026-03-27 22:51:56 [ayvens.be] INFO: Scrape type for 1985360: 2
2026-03-27 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1985360
2026-03-27 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-27 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 76552fd3-b338-580f-b2a5-4128d2e47df3, identifier: 1985360
2026-03-27 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-27 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-27 22:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360 to the API
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '76552fd3-b338-580f-b2a5-4128d2e47df3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 92640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S STYLE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S STYLE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985360%27 HTTP/1.1" 200 None
2026-03-27 22:51:56 [ayvens.be] INFO: Saving data for 1985360: {'auction_closing_time': 1774958400.0, 'created_time': 1774565386.427301, 'last_price_update_time': 1774651916.359097}
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985360') HTTP/1.1" 204 0
2026-03-27 22:51:56 [ayvens.be] INFO: Found listing with ID: 1985361
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985361%27 HTTP/1.1" 200 None
2026-03-27 22:51:56 [ayvens.be] INFO: Scrape type for 1985361: 2
2026-03-27 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1985361
2026-03-27 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-27 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aac99e38-7861-5476-8a42-9368ec6b38bb, identifier: 1985361
2026-03-27 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-27 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-27 22:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361 to the API
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aac99e38-7861-5476-8a42-9368ec6b38bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 66887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 520D 120KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520D 120KW TOURING AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985361%27 HTTP/1.1" 200 None
2026-03-27 22:51:56 [ayvens.be] INFO: Saving data for 1985361: {'auction_closing_time': 1774958400.0, 'created_time': 1774565375.469568, 'last_price_update_time': 1774651916.767904}
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985361') HTTP/1.1" 204 0
2026-03-27 22:51:56 [ayvens.be] INFO: Found listing with ID: 1985362
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985362%27 HTTP/1.1" 200 None
2026-03-27 22:51:56 [ayvens.be] INFO: Scrape type for 1985362: 2
2026-03-27 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1985362
2026-03-27 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-27 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 2
2026-03-27 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0360f333-f9a9-58e4-b8ab-91c3bc796021, identifier: 1985362
2026-03-27 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-27 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-27 22:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362 to the API
2026-03-27 22:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0360f333-f9a9-58e4-b8ab-91c3bc796021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPAu2030',
 'odometer': 77791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPAu2030 1.5 218IA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 218IA GRAN COUPE',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985362%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Saving data for 1985362: {'auction_closing_time': 1774958400.0, 'created_time': 1774565372.734699, 'last_price_update_time': 1774651917.166402}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985362') HTTP/1.1" 204 0
2026-03-27 22:51:57 [ayvens.be] INFO: Found listing with ID: 1985363
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985363%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Scrape type for 1985363: 2
2026-03-27 22:51:57 [ayvens.be] INFO: Extracting data for car ID: 1985363
2026-03-27 22:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-27 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 2
2026-03-27 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 2
2026-03-27 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5d550fb4-a647-5a1b-8837-81f98eace162, identifier: 1985363
2026-03-27 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-27 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-27 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363 to the API
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5d550fb4-a647-5a1b-8837-81f98eace162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 74198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985363%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Saving data for 1985363: {'auction_closing_time': 1774958400.0, 'created_time': 1774565375.138358, 'last_price_update_time': 1774651917.566886}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985363') HTTP/1.1" 204 0
2026-03-27 22:51:57 [ayvens.be] INFO: Found listing with ID: 1985364
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985364%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Scrape type for 1985364: 2
2026-03-27 22:51:57 [ayvens.be] INFO: Extracting data for car ID: 1985364
2026-03-27 22:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-27 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 2
2026-03-27 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 2
2026-03-27 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 572fb211-c34a-540b-b492-e638d580713e, identifier: 1985364
2026-03-27 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-27 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-27 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364 to the API
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '572fb211-c34a-540b-b492-e638d580713e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 Sportback',
 'odometer': 112798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Sportback 2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'transmission': 'automatic',
 'trim': '2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985364%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Saving data for 1985364: {'auction_closing_time': 1774958400.0, 'created_time': 1774565376.525079, 'last_price_update_time': 1774651917.944621}
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985364') HTTP/1.1" 204 0
2026-03-27 22:51:57 [ayvens.be] INFO: Found listing with ID: 1985365
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985365%27 HTTP/1.1" 200 None
2026-03-27 22:51:57 [ayvens.be] INFO: Scrape type for 1985365: 2
2026-03-27 22:51:57 [ayvens.be] INFO: Extracting data for car ID: 1985365
2026-03-27 22:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-27 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 2
2026-03-27 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 2
2026-03-27 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f18e9342-4f12-553c-b02c-5645e403a20a, identifier: 1985365
2026-03-27 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-27 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-27 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365 to the API
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f18e9342-4f12-553c-b02c-5645e403a20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985365%27 HTTP/1.1" 200 None
2026-03-27 22:51:58 [ayvens.be] INFO: Saving data for 1985365: {'auction_closing_time': 1774958400.0, 'created_time': 1774565385.547872, 'last_price_update_time': 1774651918.352276}
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985365') HTTP/1.1" 204 0
2026-03-27 22:51:58 [ayvens.be] INFO: Found listing with ID: 1985366
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985366%27 HTTP/1.1" 200 None
2026-03-27 22:51:58 [ayvens.be] INFO: Scrape type for 1985366: 2
2026-03-27 22:51:58 [ayvens.be] INFO: Extracting data for car ID: 1985366
2026-03-27 22:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-27 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 2
2026-03-27 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 2
2026-03-27 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed, identifier: 1985366
2026-03-27 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-27 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-27 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366 to the API
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b548f02-98e7-5a1f-81a8-5a1c0ec365ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 84231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985366%27 HTTP/1.1" 200 None
2026-03-27 22:51:58 [ayvens.be] INFO: Saving data for 1985366: {'auction_closing_time': 1774958400.0, 'created_time': 1774565383.680601, 'last_price_update_time': 1774651918.745598}
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985366') HTTP/1.1" 204 0
2026-03-27 22:51:58 [ayvens.be] INFO: Found listing with ID: 1985367
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985367%27 HTTP/1.1" 200 None
2026-03-27 22:51:58 [ayvens.be] INFO: Scrape type for 1985367: 2
2026-03-27 22:51:58 [ayvens.be] INFO: Extracting data for car ID: 1985367
2026-03-27 22:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-27 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 2
2026-03-27 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 2
2026-03-27 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a6db055-8436-5ac6-ad95-391afd5bbc80, identifier: 1985367
2026-03-27 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-27 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-27 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367 to the API
2026-03-27 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4a6db055-8436-5ac6-ad95-391afd5bbc80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 53093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985367%27 HTTP/1.1" 200 None
2026-03-27 22:51:59 [ayvens.be] INFO: Saving data for 1985367: {'auction_closing_time': 1774958400.0, 'created_time': 1774565380.490741, 'last_price_update_time': 1774651919.14337}
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985367') HTTP/1.1" 204 0
2026-03-27 22:51:59 [ayvens.be] INFO: Found listing with ID: 1985368
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985368%27 HTTP/1.1" 200 None
2026-03-27 22:51:59 [ayvens.be] INFO: Scrape type for 1985368: 2
2026-03-27 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1985368
2026-03-27 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-27 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 2
2026-03-27 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 2
2026-03-27 22:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9123352f-f020-520c-8c81-3f437f438310, identifier: 1985368
2026-03-27 22:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-27 22:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-27 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368 to the API
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9123352f-f020-520c-8c81-3f437f438310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 130264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985368%27 HTTP/1.1" 200 None
2026-03-27 22:51:59 [ayvens.be] INFO: Saving data for 1985368: {'auction_closing_time': 1774958400.0, 'created_time': 1774565383.184616, 'last_price_update_time': 1774651919.618477}
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985368') HTTP/1.1" 204 0
2026-03-27 22:51:59 [ayvens.be] INFO: Found listing with ID: 1985369
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985369%27 HTTP/1.1" 200 None
2026-03-27 22:51:59 [ayvens.be] INFO: Scrape type for 1985369: 2
2026-03-27 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1985369
2026-03-27 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-27 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 2
2026-03-27 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 2
2026-03-27 22:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f59e1dc1-9407-5451-af2c-f810e89334ef, identifier: 1985369
2026-03-27 22:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-27 22:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-27 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369 to the API
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f59e1dc1-9407-5451-af2c-f810e89334ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 44031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985369%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Saving data for 1985369: {'auction_closing_time': 1774958400.0, 'created_time': 1774565384.747387, 'last_price_update_time': 1774651920.026016}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985369') HTTP/1.1" 204 0
2026-03-27 22:52:00 [ayvens.be] INFO: Found listing with ID: 1985370
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985370%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Scrape type for 1985370: 2
2026-03-27 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1985370
2026-03-27 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-27 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc62ded9-a378-5b04-aa3f-1ff811f2e715, identifier: 1985370
2026-03-27 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-27 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-27 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370 to the API
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc62ded9-a378-5b04-aa3f-1ff811f2e715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 148610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 PHEV 225 BASTILLE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 BASTILLE + AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985370%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Saving data for 1985370: {'auction_closing_time': 1774958400.0, 'created_time': 1774565387.364909, 'last_price_update_time': 1774651920.434222}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985370') HTTP/1.1" 204 0
2026-03-27 22:52:00 [ayvens.be] INFO: Found listing with ID: 1985371
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985371%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Scrape type for 1985371: 2
2026-03-27 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1985371
2026-03-27 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-27 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68726777-665d-5bfe-8065-2c689b768477, identifier: 1985371
2026-03-27 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-27 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-27 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371 to the API
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '68726777-665d-5bfe-8065-2c689b768477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 112884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 1.4 EHYBRID DSG R-LINE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID DSG R-LINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985371%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Saving data for 1985371: {'auction_closing_time': 1774958400.0, 'created_time': 1774565389.211242, 'last_price_update_time': 1774651920.833195}
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985371') HTTP/1.1" 204 0
2026-03-27 22:52:00 [ayvens.be] INFO: Found listing with ID: 1985372
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985372%27 HTTP/1.1" 200 None
2026-03-27 22:52:00 [ayvens.be] INFO: Scrape type for 1985372: 2
2026-03-27 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1985372
2026-03-27 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-27 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 2
2026-03-27 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b4a4a85-7e3f-53c3-a306-36048b1efecf, identifier: 1985372
2026-03-27 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-27 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-27 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372 to the API
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9b4a4a85-7e3f-53c3-a306-36048b1efecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 68892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985372%27 HTTP/1.1" 200 None
2026-03-27 22:52:01 [ayvens.be] INFO: Saving data for 1985372: {'auction_closing_time': 1774958400.0, 'created_time': 1774565392.016887, 'last_price_update_time': 1774651921.23681}
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985372') HTTP/1.1" 204 0
2026-03-27 22:52:01 [ayvens.be] INFO: Found listing with ID: 1985373
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985373%27 HTTP/1.1" 200 None
2026-03-27 22:52:01 [ayvens.be] INFO: Scrape type for 1985373: 2
2026-03-27 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1985373
2026-03-27 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-27 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 2
2026-03-27 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 2
2026-03-27 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8, identifier: 1985373
2026-03-27 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-27 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-27 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373 to the API
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '18979b1a-ad2b-58fb-9f7b-baea2c3543a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 83182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985373%27 HTTP/1.1" 200 None
2026-03-27 22:52:01 [ayvens.be] INFO: Saving data for 1985373: {'auction_closing_time': 1774958400.0, 'created_time': 1774565393.484384, 'last_price_update_time': 1774651921.616368}
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985373') HTTP/1.1" 204 0
2026-03-27 22:52:01 [ayvens.be] INFO: Found listing with ID: 1985374
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985374%27 HTTP/1.1" 200 None
2026-03-27 22:52:01 [ayvens.be] INFO: Scrape type for 1985374: 2
2026-03-27 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1985374
2026-03-27 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-27 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 2
2026-03-27 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 2
2026-03-27 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0, identifier: 1985374
2026-03-27 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-27 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-27 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374 to the API
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 157391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 1.5 ECOBLUE 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 ECOBLUE 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985374%27 HTTP/1.1" 200 None
2026-03-27 22:52:01 [ayvens.be] INFO: Saving data for 1985374: {'auction_closing_time': 1774958400.0, 'created_time': 1774565395.103573, 'last_price_update_time': 1774651921.997384}
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985374') HTTP/1.1" 204 0
2026-03-27 22:52:02 [ayvens.be] INFO: Found listing with ID: 1985375
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985375%27 HTTP/1.1" 200 None
2026-03-27 22:52:02 [ayvens.be] INFO: Scrape type for 1985375: 2
2026-03-27 22:52:02 [ayvens.be] INFO: Extracting data for car ID: 1985375
2026-03-27 22:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-27 22:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 2
2026-03-27 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 2
2026-03-27 22:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9, identifier: 1985375
2026-03-27 22:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-27 22:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-27 22:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375 to the API
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '010c1aea-c107-5cbc-ab3b-b1ae80957cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX2',
 'odometer': 7987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX2 BEV 67KWH EDRIVE20 150KW',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW',
 'vin': None,
 'year': 2025}
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985375%27 HTTP/1.1" 200 None
2026-03-27 22:52:02 [ayvens.be] INFO: Saving data for 1985375: {'auction_closing_time': 1774958400.0, 'created_time': 1774565396.517354, 'last_price_update_time': 1774651922.534742}
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985375') HTTP/1.1" 204 0
2026-03-27 22:52:02 [ayvens.be] INFO: Found listing with ID: 1985376
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985376%27 HTTP/1.1" 200 None
2026-03-27 22:52:02 [ayvens.be] INFO: Scrape type for 1985376: 2
2026-03-27 22:52:02 [ayvens.be] INFO: Extracting data for car ID: 1985376
2026-03-27 22:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-27 22:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 2
2026-03-27 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 2
2026-03-27 22:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f513ab40-e80d-5508-9312-ecf3faf2e7c3, identifier: 1985376
2026-03-27 22:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-27 22:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-27 22:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376 to the API
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f513ab40-e80d-5508-9312-ecf3faf2e7c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 114644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985376%27 HTTP/1.1" 200 None
2026-03-27 22:52:02 [ayvens.be] INFO: Saving data for 1985376: {'auction_closing_time': 1774958400.0, 'created_time': 1774565398.781483, 'last_price_update_time': 1774651922.937336}
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985376') HTTP/1.1" 204 0
2026-03-27 22:52:02 [ayvens.be] INFO: Found listing with ID: 1985377
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985377%27 HTTP/1.1" 200 None
2026-03-27 22:52:02 [ayvens.be] INFO: Scrape type for 1985377: 2
2026-03-27 22:52:02 [ayvens.be] INFO: Extracting data for car ID: 1985377
2026-03-27 22:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-27 22:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 2
2026-03-27 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 2
2026-03-27 22:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec, identifier: 1985377
2026-03-27 22:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-27 22:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-27 22:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377 to the API
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c7b5d90a-9f2f-5747-9d5b-37a0f833ddec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 38605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2024}
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985377%27 HTTP/1.1" 200 None
2026-03-27 22:52:03 [ayvens.be] INFO: Saving data for 1985377: {'auction_closing_time': 1774958400.0, 'created_time': 1774565399.728773, 'last_price_update_time': 1774651923.316713}
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985377') HTTP/1.1" 204 0
2026-03-27 22:52:03 [ayvens.be] INFO: Found listing with ID: 1985378
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985378%27 HTTP/1.1" 200 None
2026-03-27 22:52:03 [ayvens.be] INFO: Scrape type for 1985378: 2
2026-03-27 22:52:03 [ayvens.be] INFO: Extracting data for car ID: 1985378
2026-03-27 22:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-27 22:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 2
2026-03-27 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 2
2026-03-27 22:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55582b44-2a1a-55ba-8550-803dbcef7bd5, identifier: 1985378
2026-03-27 22:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-27 22:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-27 22:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378 to the API
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '55582b44-2a1a-55ba-8550-803dbcef7bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 72990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985378%27 HTTP/1.1" 200 None
2026-03-27 22:52:03 [ayvens.be] INFO: Saving data for 1985378: {'auction_closing_time': 1774958400.0, 'created_time': 1774565401.131829, 'last_price_update_time': 1774651923.805696}
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985378') HTTP/1.1" 204 0
2026-03-27 22:52:03 [ayvens.be] INFO: Found listing with ID: 1985379
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985379%27 HTTP/1.1" 200 None
2026-03-27 22:52:03 [ayvens.be] INFO: Scrape type for 1985379: 2
2026-03-27 22:52:03 [ayvens.be] INFO: Extracting data for car ID: 1985379
2026-03-27 22:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-27 22:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 2
2026-03-27 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 2
2026-03-27 22:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 41f97a93-de3c-5513-bb76-4e8deedf18cb, identifier: 1985379
2026-03-27 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-27 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-27 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379 to the API
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '41f97a93-de3c-5513-bb76-4e8deedf18cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 195502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse 1.5 A 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.5 A 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985379%27 HTTP/1.1" 200 None
2026-03-27 22:52:04 [ayvens.be] INFO: Saving data for 1985379: {'auction_closing_time': 1774958400.0, 'created_time': 1774565402.950517, 'last_price_update_time': 1774651924.261422}
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985379') HTTP/1.1" 204 0
2026-03-27 22:52:04 [ayvens.be] INFO: Found listing with ID: 1985380
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985380%27 HTTP/1.1" 200 None
2026-03-27 22:52:04 [ayvens.be] INFO: Scrape type for 1985380: 2
2026-03-27 22:52:04 [ayvens.be] INFO: Extracting data for car ID: 1985380
2026-03-27 22:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-27 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 2
2026-03-27 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 2
2026-03-27 22:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 335e1b92-8dec-5058-af43-5393f02dbe77, identifier: 1985380
2026-03-27 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-27 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-27 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380 to the API
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '335e1b92-8dec-5058-af43-5393f02dbe77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 103020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985380%27 HTTP/1.1" 200 None
2026-03-27 22:52:04 [ayvens.be] INFO: Saving data for 1985380: {'auction_closing_time': 1774958400.0, 'created_time': 1774565405.333434, 'last_price_update_time': 1774651924.635977}
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985380') HTTP/1.1" 204 0
2026-03-27 22:52:04 [ayvens.be] INFO: Found listing with ID: 1985381
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985381%27 HTTP/1.1" 200 None
2026-03-27 22:52:04 [ayvens.be] INFO: Scrape type for 1985381: 2
2026-03-27 22:52:04 [ayvens.be] INFO: Extracting data for car ID: 1985381
2026-03-27 22:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-27 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 2
2026-03-27 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 2
2026-03-27 22:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0935e4d3-aba0-574f-a79e-8f1945954b6d, identifier: 1985381
2026-03-27 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-27 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-27 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381 to the API
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0935e4d3-aba0-574f-a79e-8f1945954b6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 127120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW DSG ACTIVE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985381%27 HTTP/1.1" 200 None
2026-03-27 22:52:05 [ayvens.be] INFO: Saving data for 1985381: {'auction_closing_time': 1774958400.0, 'created_time': 1774565406.651357, 'last_price_update_time': 1774651925.041623}
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985381') HTTP/1.1" 204 0
2026-03-27 22:52:05 [ayvens.be] INFO: Found listing with ID: 1985382
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985382%27 HTTP/1.1" 200 None
2026-03-27 22:52:05 [ayvens.be] INFO: Scrape type for 1985382: 2
2026-03-27 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1985382
2026-03-27 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-27 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 2
2026-03-27 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 2
2026-03-27 22:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 959ab10b-8f5d-572c-96e3-29bf3d30a140, identifier: 1985382
2026-03-27 22:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-27 22:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-27 22:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382 to the API
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '959ab10b-8f5d-572c-96e3-29bf3d30a140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 164549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985382%27 HTTP/1.1" 200 None
2026-03-27 22:52:05 [ayvens.be] INFO: Saving data for 1985382: {'auction_closing_time': 1774958400.0, 'created_time': 1774565407.805325, 'last_price_update_time': 1774651925.889222}
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985382') HTTP/1.1" 204 0
2026-03-27 22:52:05 [ayvens.be] INFO: Found listing with ID: 1985383
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985383%27 HTTP/1.1" 200 None
2026-03-27 22:52:05 [ayvens.be] INFO: Scrape type for 1985383: 2
2026-03-27 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1985383
2026-03-27 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-27 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 2
2026-03-27 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 2
2026-03-27 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e, identifier: 1985383
2026-03-27 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-27 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-27 22:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383 to the API
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c93adac2-ee3a-5713-82d6-2c1a80d6ee8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 67371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985383%27 HTTP/1.1" 200 None
2026-03-27 22:52:06 [ayvens.be] INFO: Saving data for 1985383: {'auction_closing_time': 1774958400.0, 'created_time': 1774565410.050982, 'last_price_update_time': 1774651926.274783}
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985383') HTTP/1.1" 204 0
2026-03-27 22:52:06 [ayvens.be] INFO: Found listing with ID: 1985384
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985384%27 HTTP/1.1" 200 None
2026-03-27 22:52:06 [ayvens.be] INFO: Scrape type for 1985384: 2
2026-03-27 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1985384
2026-03-27 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-27 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 2
2026-03-27 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 2
2026-03-27 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a826a95-196a-50d9-9c13-656a021883c3, identifier: 1985384
2026-03-27 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-27 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-27 22:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384 to the API
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2a826a95-196a-50d9-9c13-656a021883c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 108460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985384%27 HTTP/1.1" 200 None
2026-03-27 22:52:06 [ayvens.be] INFO: Saving data for 1985384: {'auction_closing_time': 1774958400.0, 'created_time': 1774565411.714491, 'last_price_update_time': 1774651926.791308}
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985384') HTTP/1.1" 204 0
2026-03-27 22:52:06 [ayvens.be] INFO: Found listing with ID: 1985385
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985385%27 HTTP/1.1" 200 None
2026-03-27 22:52:06 [ayvens.be] INFO: Scrape type for 1985385: 2
2026-03-27 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1985385
2026-03-27 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-27 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 2
2026-03-27 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 2
2026-03-27 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 204b260e-559e-573a-a182-0234b1a52c5d, identifier: 1985385
2026-03-27 22:52:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -2 pages/min), scraped 367 items (at 127 items/min)
2026-03-27 22:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-27 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-27 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385 to the API
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '204b260e-559e-573a-a182-0234b1a52c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 46415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985385%27 HTTP/1.1" 200 None
2026-03-27 22:52:07 [ayvens.be] INFO: Saving data for 1985385: {'auction_closing_time': 1774958400.0, 'created_time': 1774565413.096715, 'last_price_update_time': 1774651927.188341}
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985385') HTTP/1.1" 204 0
2026-03-27 22:52:07 [ayvens.be] INFO: Found listing with ID: 1985386
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985386%27 HTTP/1.1" 200 None
2026-03-27 22:52:07 [ayvens.be] INFO: Scrape type for 1985386: 2
2026-03-27 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1985386
2026-03-27 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-27 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 2
2026-03-27 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 2
2026-03-27 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cd1f4af-ca6c-5179-834b-195bc36a2958, identifier: 1985386
2026-03-27 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-27 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-27 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386 to the API
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2cd1f4af-ca6c-5179-834b-195bc36a2958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 107677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '2.0 CRTDI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985386%27 HTTP/1.1" 200 None
2026-03-27 22:52:07 [ayvens.be] INFO: Saving data for 1985386: {'auction_closing_time': 1774958400.0, 'created_time': 1774565415.225347, 'last_price_update_time': 1774651927.610166}
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985386') HTTP/1.1" 204 0
2026-03-27 22:52:07 [ayvens.be] INFO: Found listing with ID: 1985387
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985387%27 HTTP/1.1" 200 None
2026-03-27 22:52:07 [ayvens.be] INFO: Scrape type for 1985387: 2
2026-03-27 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1985387
2026-03-27 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-27 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 2
2026-03-27 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 2
2026-03-27 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d435f3e0-529f-510b-bac6-ad11c65d9078, identifier: 1985387
2026-03-27 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-27 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-27 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387 to the API
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'd435f3e0-529f-510b-bac6-ad11c65d9078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 188744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 78KWH RECHARGE TWIN PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN PLUS',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985387%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Saving data for 1985387: {'auction_closing_time': 1774958400.0, 'created_time': 1774565416.594016, 'last_price_update_time': 1774651928.023166}
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985387') HTTP/1.1" 204 0
2026-03-27 22:52:08 [ayvens.be] INFO: Found listing with ID: 1985388
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985388%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Scrape type for 1985388: 2
2026-03-27 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1985388
2026-03-27 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-27 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 2
2026-03-27 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 2
2026-03-27 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd5e129c-9014-5e1f-8926-20ca8a02deb0, identifier: 1985388
2026-03-27 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-27 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-27 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388 to the API
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bd5e129c-9014-5e1f-8926-20ca8a02deb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 187410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV CORE DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV CORE DCT',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985388%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Saving data for 1985388: {'auction_closing_time': 1774958400.0, 'created_time': 1774565417.651884, 'last_price_update_time': 1774651928.415872}
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985388') HTTP/1.1" 204 0
2026-03-27 22:52:08 [ayvens.be] INFO: Found listing with ID: 1985389
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985389%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Scrape type for 1985389: 2
2026-03-27 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1985389
2026-03-27 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-27 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 2
2026-03-27 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 2
2026-03-27 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f848b84-78f6-5388-b7ab-a5470e154ec1, identifier: 1985389
2026-03-27 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-27 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-27 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389 to the API
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f848b84-78f6-5388-b7ab-a5470e154ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 53679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'transmission': 'automatic',
 'trim': '1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985389%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Saving data for 1985389: {'auction_closing_time': 1774958400.0, 'created_time': 1774565419.348604, 'last_price_update_time': 1774651928.808409}
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985389') HTTP/1.1" 204 0
2026-03-27 22:52:08 [ayvens.be] INFO: Found listing with ID: 1985390
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985390%27 HTTP/1.1" 200 None
2026-03-27 22:52:08 [ayvens.be] INFO: Scrape type for 1985390: 2
2026-03-27 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1985390
2026-03-27 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-27 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 2
2026-03-27 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 2
2026-03-27 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, identifier: 1985390
2026-03-27 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-27 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-27 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390 to the API
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b30eb02b-510e-5cce-8b0c-c2f43e8c5e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 54790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985390%27 HTTP/1.1" 200 None
2026-03-27 22:52:09 [ayvens.be] INFO: Saving data for 1985390: {'auction_closing_time': 1774958400.0, 'created_time': 1774565421.532063, 'last_price_update_time': 1774651929.307092}
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985390') HTTP/1.1" 204 0
2026-03-27 22:52:09 [ayvens.be] INFO: Found listing with ID: 1985391
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985391%27 HTTP/1.1" 200 None
2026-03-27 22:52:09 [ayvens.be] INFO: Scrape type for 1985391: 2
2026-03-27 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1985391
2026-03-27 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-27 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 2
2026-03-27 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 2
2026-03-27 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70e0a53-f615-5e36-8282-b789dd1802c1, identifier: 1985391
2026-03-27 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-27 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-27 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391 to the API
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e70e0a53-f615-5e36-8282-b789dd1802c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 71679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985391%27 HTTP/1.1" 200 None
2026-03-27 22:52:09 [ayvens.be] INFO: Saving data for 1985391: {'auction_closing_time': 1774958400.0, 'created_time': 1774565423.013443, 'last_price_update_time': 1774651929.707407}
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985391') HTTP/1.1" 204 0
2026-03-27 22:52:09 [ayvens.be] INFO: Found listing with ID: 1985392
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985392%27 HTTP/1.1" 200 None
2026-03-27 22:52:09 [ayvens.be] INFO: Scrape type for 1985392: 2
2026-03-27 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1985392
2026-03-27 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-27 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 2
2026-03-27 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 2
2026-03-27 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9474db12-7db3-5b4b-b87e-d1af39983ce6, identifier: 1985392
2026-03-27 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-27 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-27 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392 to the API
2026-03-27 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9474db12-7db3-5b4b-b87e-d1af39983ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 164062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985392%27 HTTP/1.1" 200 None
2026-03-27 22:52:10 [ayvens.be] INFO: Saving data for 1985392: {'auction_closing_time': 1774958400.0, 'created_time': 1774565424.053047, 'last_price_update_time': 1774651930.123397}
2026-03-27 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985392') HTTP/1.1" 204 0
2026-03-27 22:52:10 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-27 22:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:52:12 [ayvens.be] INFO: Found listing with ID: 1985393
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985393%27 HTTP/1.1" 200 None
2026-03-27 22:52:12 [ayvens.be] INFO: Scrape type for 1985393: 2
2026-03-27 22:52:12 [ayvens.be] INFO: Extracting data for car ID: 1985393
2026-03-27 22:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-27 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 2
2026-03-27 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 2
2026-03-27 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad, identifier: 1985393
2026-03-27 22:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-27 22:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-27 22:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393 to the API
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ac0fe51-d303-5c51-b4c4-e751c647c8ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 123145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985393%27 HTTP/1.1" 200 None
2026-03-27 22:52:12 [ayvens.be] INFO: Saving data for 1985393: {'auction_closing_time': 1774958400.0, 'created_time': 1774565426.116583, 'last_price_update_time': 1774651932.662197}
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985393') HTTP/1.1" 204 0
2026-03-27 22:52:12 [ayvens.be] INFO: Found listing with ID: 1985394
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985394%27 HTTP/1.1" 200 None
2026-03-27 22:52:12 [ayvens.be] INFO: Scrape type for 1985394: 2
2026-03-27 22:52:12 [ayvens.be] INFO: Extracting data for car ID: 1985394
2026-03-27 22:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-27 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 2
2026-03-27 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 2
2026-03-27 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e27584de-cb42-5218-b907-d6972bd9fd0f, identifier: 1985394
2026-03-27 22:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-27 22:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-27 22:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394 to the API
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e27584de-cb42-5218-b907-d6972bd9fd0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 110564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985394%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Saving data for 1985394: {'auction_closing_time': 1774958400.0, 'created_time': 1774565427.088802, 'last_price_update_time': 1774651933.044783}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985394') HTTP/1.1" 204 0
2026-03-27 22:52:13 [ayvens.be] INFO: Found listing with ID: 1985395
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985395%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Scrape type for 1985395: 2
2026-03-27 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1985395
2026-03-27 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-27 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce, identifier: 1985395
2026-03-27 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-27 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-27 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395 to the API
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '80018c57-88ef-58a6-b4d1-48e1d08fa0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 116706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985395%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Saving data for 1985395: {'auction_closing_time': 1774958400.0, 'created_time': 1774565430.320032, 'last_price_update_time': 1774651933.423001}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985395') HTTP/1.1" 204 0
2026-03-27 22:52:13 [ayvens.be] INFO: Found listing with ID: 1985396
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985396%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Scrape type for 1985396: 2
2026-03-27 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1985396
2026-03-27 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-27 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d99e8d78-c155-5dae-996d-4af8f0bf5beb, identifier: 1985396
2026-03-27 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-27 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-27 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396 to the API
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd99e8d78-c155-5dae-996d-4af8f0bf5beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 120860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985396%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Saving data for 1985396: {'auction_closing_time': 1774958400.0, 'created_time': 1774565431.898034, 'last_price_update_time': 1774651933.806372}
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985396') HTTP/1.1" 204 0
2026-03-27 22:52:13 [ayvens.be] INFO: Found listing with ID: 1985397
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985397%27 HTTP/1.1" 200 None
2026-03-27 22:52:13 [ayvens.be] INFO: Scrape type for 1985397: 2
2026-03-27 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1985397
2026-03-27 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-27 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 2
2026-03-27 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, identifier: 1985397
2026-03-27 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-27 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-27 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397 to the API
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b68131d5-3bb8-563a-a9f7-13cf7d85e87d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 173866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985397%27 HTTP/1.1" 200 None
2026-03-27 22:52:14 [ayvens.be] INFO: Saving data for 1985397: {'auction_closing_time': 1774958400.0, 'created_time': 1774565433.685434, 'last_price_update_time': 1774651934.200166}
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985397') HTTP/1.1" 204 0
2026-03-27 22:52:14 [ayvens.be] INFO: Found listing with ID: 1985398
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985398%27 HTTP/1.1" 200 None
2026-03-27 22:52:14 [ayvens.be] INFO: Scrape type for 1985398: 2
2026-03-27 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1985398
2026-03-27 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-27 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 2
2026-03-27 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 2
2026-03-27 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, identifier: 1985398
2026-03-27 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-27 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-27 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398 to the API
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c226416-0ac9-5e76-b8df-1e2ae4911fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 31143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985398%27 HTTP/1.1" 200 None
2026-03-27 22:52:14 [ayvens.be] INFO: Saving data for 1985398: {'auction_closing_time': 1774958400.0, 'created_time': 1774565435.621763, 'last_price_update_time': 1774651934.591479}
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985398') HTTP/1.1" 204 0
2026-03-27 22:52:14 [ayvens.be] INFO: Found listing with ID: 1985399
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985399%27 HTTP/1.1" 200 None
2026-03-27 22:52:14 [ayvens.be] INFO: Scrape type for 1985399: 2
2026-03-27 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1985399
2026-03-27 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-27 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 2
2026-03-27 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 2
2026-03-27 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01115e5d-60ff-5dfb-bc55-79d8d479682e, identifier: 1985399
2026-03-27 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-27 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-27 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399 to the API
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'CAVANSITE BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '01115e5d-60ff-5dfb-bc55-79d8d479682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 215432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985399%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Saving data for 1985399: {'auction_closing_time': 1774958400.0, 'created_time': 1774565437.169248, 'last_price_update_time': 1774651935.034789}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985399') HTTP/1.1" 204 0
2026-03-27 22:52:15 [ayvens.be] INFO: Found listing with ID: 1985400
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985400%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Scrape type for 1985400: 2
2026-03-27 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1985400
2026-03-27 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-27 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 2
2026-03-27 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 2
2026-03-27 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, identifier: 1985400
2026-03-27 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-27 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-27 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400 to the API
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 10835175,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '06d66e48-2f7e-53b5-a957-8c3f93250b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 35175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985400%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Saving data for 1985400: {'auction_closing_time': 1774958400.0, 'created_time': 1774565438.523916, 'last_price_update_time': 1774651935.411552}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985400') HTTP/1.1" 204 0
2026-03-27 22:52:15 [ayvens.be] INFO: Found listing with ID: 1985401
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985401%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Scrape type for 1985401: 2
2026-03-27 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1985401
2026-03-27 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-27 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 2
2026-03-27 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 2
2026-03-27 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d532fdcb-13d5-5c50-9730-da86ec6cb242, identifier: 1985401
2026-03-27 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-27 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-27 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401 to the API
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd532fdcb-13d5-5c50-9730-da86ec6cb242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985401%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Saving data for 1985401: {'auction_closing_time': 1774958400.0, 'created_time': 1774565439.856748, 'last_price_update_time': 1774651935.876797}
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985401') HTTP/1.1" 204 0
2026-03-27 22:52:15 [ayvens.be] INFO: Found listing with ID: 1985402
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985402%27 HTTP/1.1" 200 None
2026-03-27 22:52:15 [ayvens.be] INFO: Scrape type for 1985402: 2
2026-03-27 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1985402
2026-03-27 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-27 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 2
2026-03-27 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 2
2026-03-27 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cccef83-c8e9-5e43-a466-86f3038f3493, identifier: 1985402
2026-03-27 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-27 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-27 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402 to the API
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0cccef83-c8e9-5e43-a466-86f3038f3493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 74920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985402%27 HTTP/1.1" 200 None
2026-03-27 22:52:16 [ayvens.be] INFO: Saving data for 1985402: {'auction_closing_time': 1774958400.0, 'created_time': 1774565442.21489, 'last_price_update_time': 1774651936.27836}
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985402') HTTP/1.1" 204 0
2026-03-27 22:52:16 [ayvens.be] INFO: Found listing with ID: 1985403
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985403%27 HTTP/1.1" 200 None
2026-03-27 22:52:16 [ayvens.be] INFO: Scrape type for 1985403: 2
2026-03-27 22:52:16 [ayvens.be] INFO: Extracting data for car ID: 1985403
2026-03-27 22:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-27 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 2
2026-03-27 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 2
2026-03-27 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a479119-61e5-5b1a-b329-a6f67a5b7217, identifier: 1985403
2026-03-27 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-27 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-27 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403 to the API
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3a479119-61e5-5b1a-b329-a6f67a5b7217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 100504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985403%27 HTTP/1.1" 200 None
2026-03-27 22:52:16 [ayvens.be] INFO: Saving data for 1985403: {'auction_closing_time': 1774958400.0, 'created_time': 1774565443.412778, 'last_price_update_time': 1774651936.690701}
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985403') HTTP/1.1" 204 0
2026-03-27 22:52:16 [ayvens.be] INFO: Found listing with ID: 1985404
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985404%27 HTTP/1.1" 200 None
2026-03-27 22:52:16 [ayvens.be] INFO: Scrape type for 1985404: 2
2026-03-27 22:52:16 [ayvens.be] INFO: Extracting data for car ID: 1985404
2026-03-27 22:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-27 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 2
2026-03-27 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 2
2026-03-27 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a206e3e-7dc8-586a-86ea-5675f49b7965, identifier: 1985404
2026-03-27 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-27 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-27 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404 to the API
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a206e3e-7dc8-586a-86ea-5675f49b7965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 72093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985404%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Saving data for 1985404: {'auction_closing_time': 1774958400.0, 'created_time': 1774565445.028697, 'last_price_update_time': 1774651937.107638}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985404') HTTP/1.1" 204 0
2026-03-27 22:52:17 [ayvens.be] INFO: Found listing with ID: 1985405
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985405%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Scrape type for 1985405: 2
2026-03-27 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1985405
2026-03-27 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-27 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 2
2026-03-27 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 2
2026-03-27 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4378404c-4d48-5176-8a9d-538d8488156b, identifier: 1985405
2026-03-27 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-27 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-27 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405 to the API
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4378404c-4d48-5176-8a9d-538d8488156b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 58116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985405%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Saving data for 1985405: {'auction_closing_time': 1774958400.0, 'created_time': 1774565446.256845, 'last_price_update_time': 1774651937.504311}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985405') HTTP/1.1" 204 0
2026-03-27 22:52:17 [ayvens.be] INFO: Found listing with ID: 1985406
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985406%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Scrape type for 1985406: 2
2026-03-27 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1985406
2026-03-27 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-27 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 2
2026-03-27 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 2
2026-03-27 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59caa32e-8ead-511a-a254-01be2d4c5584, identifier: 1985406
2026-03-27 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-27 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-27 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406 to the API
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '59caa32e-8ead-511a-a254-01be2d4c5584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 61231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985406%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Saving data for 1985406: {'auction_closing_time': 1774958400.0, 'created_time': 1774565447.873638, 'last_price_update_time': 1774651937.89629}
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985406') HTTP/1.1" 204 0
2026-03-27 22:52:17 [ayvens.be] INFO: Found listing with ID: 1985407
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985407%27 HTTP/1.1" 200 None
2026-03-27 22:52:17 [ayvens.be] INFO: Scrape type for 1985407: 2
2026-03-27 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1985407
2026-03-27 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-27 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 2
2026-03-27 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 2
2026-03-27 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce58b6a6-8a34-5601-8af8-073b8badc5c5, identifier: 1985407
2026-03-27 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-27 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-27 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407 to the API
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ce58b6a6-8a34-5601-8af8-073b8badc5c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 60155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E LUXURY LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E LUXURY LINE DCT SH BR',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985407%27 HTTP/1.1" 200 None
2026-03-27 22:52:18 [ayvens.be] INFO: Saving data for 1985407: {'auction_closing_time': 1774958400.0, 'created_time': 1774565450.413531, 'last_price_update_time': 1774651938.289887}
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985407') HTTP/1.1" 204 0
2026-03-27 22:52:18 [ayvens.be] INFO: Found listing with ID: 1985408
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985408%27 HTTP/1.1" 200 None
2026-03-27 22:52:18 [ayvens.be] INFO: Scrape type for 1985408: 2
2026-03-27 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1985408
2026-03-27 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-27 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 2
2026-03-27 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 2
2026-03-27 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a, identifier: 1985408
2026-03-27 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-27 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-27 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408 to the API
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7eacb2e9-21c7-546e-a8ff-8314d7a7253a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 120135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985408%27 HTTP/1.1" 200 None
2026-03-27 22:52:18 [ayvens.be] INFO: Saving data for 1985408: {'auction_closing_time': 1774958400.0, 'created_time': 1774565452.17277, 'last_price_update_time': 1774651938.682269}
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985408') HTTP/1.1" 204 0
2026-03-27 22:52:18 [ayvens.be] INFO: Found listing with ID: 1985409
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985409%27 HTTP/1.1" 200 None
2026-03-27 22:52:18 [ayvens.be] INFO: Scrape type for 1985409: 2
2026-03-27 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1985409
2026-03-27 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-27 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 2
2026-03-27 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 2
2026-03-27 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb, identifier: 1985409
2026-03-27 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-27 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-27 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409 to the API
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8901dd7c-fe65-538f-9a8d-02dcb9b8fabb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 80086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.2I 96KW SWB COMFORT AUTO',
 'transmission': 'automatic',
 'trim': '1.2I 96KW SWB COMFORT AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985409%27 HTTP/1.1" 200 None
2026-03-27 22:52:19 [ayvens.be] INFO: Saving data for 1985409: {'auction_closing_time': 1774958400.0, 'created_time': 1774565453.719712, 'last_price_update_time': 1774651939.10285}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985409') HTTP/1.1" 204 0
2026-03-27 22:52:19 [ayvens.be] INFO: Found listing with ID: 1985410
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985410%27 HTTP/1.1" 200 None
2026-03-27 22:52:19 [ayvens.be] INFO: Scrape type for 1985410: 2
2026-03-27 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1985410
2026-03-27 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-27 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 2
2026-03-27 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 2
2026-03-27 22:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b69abcb1-2d81-5245-b20d-dba2e0f2ba47, identifier: 1985410
2026-03-27 22:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-27 22:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-27 22:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410 to the API
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b69abcb1-2d81-5245-b20d-dba2e0f2ba47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 128237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985410%27 HTTP/1.1" 200 None
2026-03-27 22:52:19 [ayvens.be] INFO: Saving data for 1985410: {'auction_closing_time': 1774958400.0, 'created_time': 1774565454.691634, 'last_price_update_time': 1774651939.529876}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985410') HTTP/1.1" 204 0
2026-03-27 22:52:19 [ayvens.be] INFO: Found listing with ID: 1985411
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985411%27 HTTP/1.1" 200 None
2026-03-27 22:52:19 [ayvens.be] INFO: Scrape type for 1985411: 2
2026-03-27 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1985411
2026-03-27 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-27 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 2
2026-03-27 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 2
2026-03-27 22:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6329b518-a0d7-5100-aa37-31aadb1cd7a5, identifier: 1985411
2026-03-27 22:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-27 22:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-27 22:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411 to the API
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6329b518-a0d7-5100-aa37-31aadb1cd7a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 127995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) XDRIVE TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985411%27 HTTP/1.1" 200 None
2026-03-27 22:52:19 [ayvens.be] INFO: Saving data for 1985411: {'auction_closing_time': 1774958400.0, 'created_time': 1774565456.395532, 'last_price_update_time': 1774651939.941636}
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985411') HTTP/1.1" 204 0
2026-03-27 22:52:20 [ayvens.be] INFO: Found listing with ID: 1985412
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985412%27 HTTP/1.1" 200 None
2026-03-27 22:52:20 [ayvens.be] INFO: Scrape type for 1985412: 2
2026-03-27 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1985412
2026-03-27 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-27 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2dcfa284-9a34-5515-b429-8748e9d277cc, identifier: 1985412
2026-03-27 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-27 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-27 22:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412 to the API
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2dcfa284-9a34-5515-b429-8748e9d277cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2017',
 'odometer': 109215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2017 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985412%27 HTTP/1.1" 200 None
2026-03-27 22:52:20 [ayvens.be] INFO: Saving data for 1985412: {'auction_closing_time': 1774958400.0, 'created_time': 1774565457.874107, 'last_price_update_time': 1774651940.406876}
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985412') HTTP/1.1" 204 0
2026-03-27 22:52:20 [ayvens.be] INFO: Found listing with ID: 1985413
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985413%27 HTTP/1.1" 200 None
2026-03-27 22:52:20 [ayvens.be] INFO: Scrape type for 1985413: 2
2026-03-27 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1985413
2026-03-27 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-27 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bb9d0228-9c97-532f-a19b-9fa29c9ae81c, identifier: 1985413
2026-03-27 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-27 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-27 22:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413 to the API
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bb9d0228-9c97-532f-a19b-9fa29c9ae81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 159427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985413%27 HTTP/1.1" 200 None
2026-03-27 22:52:20 [ayvens.be] INFO: Saving data for 1985413: {'auction_closing_time': 1774958400.0, 'created_time': 1774565459.32529, 'last_price_update_time': 1774651940.810525}
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985413') HTTP/1.1" 204 0
2026-03-27 22:52:20 [ayvens.be] INFO: Found listing with ID: 1985414
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985414%27 HTTP/1.1" 200 None
2026-03-27 22:52:20 [ayvens.be] INFO: Scrape type for 1985414: 2
2026-03-27 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1985414
2026-03-27 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-27 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 2
2026-03-27 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94, identifier: 1985414
2026-03-27 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-27 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-27 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414 to the API
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 113990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985414%27 HTTP/1.1" 200 None
2026-03-27 22:52:21 [ayvens.be] INFO: Saving data for 1985414: {'auction_closing_time': 1774958400.0, 'created_time': 1774565460.813944, 'last_price_update_time': 1774651941.200436}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985414') HTTP/1.1" 204 0
2026-03-27 22:52:21 [ayvens.be] INFO: Found listing with ID: 1985415
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985415%27 HTTP/1.1" 200 None
2026-03-27 22:52:21 [ayvens.be] INFO: Scrape type for 1985415: 2
2026-03-27 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1985415
2026-03-27 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-27 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 2
2026-03-27 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 2
2026-03-27 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfd4a740-44f9-552f-baa0-850394236255, identifier: 1985415
2026-03-27 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-27 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-27 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415 to the API
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bfd4a740-44f9-552f-baa0-850394236255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 90730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985415%27 HTTP/1.1" 200 None
2026-03-27 22:52:21 [ayvens.be] INFO: Saving data for 1985415: {'auction_closing_time': 1774958400.0, 'created_time': 1774565463.001194, 'last_price_update_time': 1774651941.611559}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985415') HTTP/1.1" 204 0
2026-03-27 22:52:21 [ayvens.be] INFO: Found listing with ID: 1985416
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985416%27 HTTP/1.1" 200 None
2026-03-27 22:52:21 [ayvens.be] INFO: Scrape type for 1985416: 2
2026-03-27 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1985416
2026-03-27 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-27 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 2
2026-03-27 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 2
2026-03-27 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6992e750-cb41-5f4d-961d-bf0913a096ba, identifier: 1985416
2026-03-27 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-27 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-27 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416 to the API
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6992e750-cb41-5f4d-961d-bf0913a096ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 29642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985416%27 HTTP/1.1" 200 None
2026-03-27 22:52:21 [ayvens.be] INFO: Saving data for 1985416: {'auction_closing_time': 1774958400.0, 'created_time': 1774565464.206135, 'last_price_update_time': 1774651941.99156}
2026-03-27 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985416') HTTP/1.1" 204 0
2026-03-27 22:52:22 [ayvens.be] INFO: Found listing with ID: 1985417
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985417%27 HTTP/1.1" 200 None
2026-03-27 22:52:22 [ayvens.be] INFO: Scrape type for 1985417: 2
2026-03-27 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1985417
2026-03-27 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-27 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, identifier: 1985417
2026-03-27 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-27 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-27 22:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417 to the API
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd3824f0f-7f9e-5c51-b42c-79ea05c8283e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985417%27 HTTP/1.1" 200 None
2026-03-27 22:52:22 [ayvens.be] INFO: Saving data for 1985417: {'auction_closing_time': 1774958400.0, 'created_time': 1774565466.434055, 'last_price_update_time': 1774651942.407525}
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985417') HTTP/1.1" 204 0
2026-03-27 22:52:22 [ayvens.be] INFO: Found listing with ID: 1985418
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985418%27 HTTP/1.1" 200 None
2026-03-27 22:52:22 [ayvens.be] INFO: Scrape type for 1985418: 2
2026-03-27 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1985418
2026-03-27 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-27 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, identifier: 1985418
2026-03-27 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-27 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-27 22:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418 to the API
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3523fb47-4378-50b8-98c0-ddf9b02d04ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 93484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985418%27 HTTP/1.1" 200 None
2026-03-27 22:52:22 [ayvens.be] INFO: Saving data for 1985418: {'auction_closing_time': 1774958400.0, 'created_time': 1774565468.082764, 'last_price_update_time': 1774651942.837322}
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985418') HTTP/1.1" 204 0
2026-03-27 22:52:22 [ayvens.be] INFO: Found listing with ID: 1985419
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985419%27 HTTP/1.1" 200 None
2026-03-27 22:52:22 [ayvens.be] INFO: Scrape type for 1985419: 2
2026-03-27 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1985419
2026-03-27 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-27 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 2
2026-03-27 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, identifier: 1985419
2026-03-27 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-27 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-27 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419 to the API
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a2b7706-9cb9-50f9-bf45-1d72b1675d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 61319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985419%27 HTTP/1.1" 200 None
2026-03-27 22:52:23 [ayvens.be] INFO: Saving data for 1985419: {'auction_closing_time': 1774958400.0, 'created_time': 1774565470.722329, 'last_price_update_time': 1774651943.227579}
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985419') HTTP/1.1" 204 0
2026-03-27 22:52:23 [ayvens.be] INFO: Found listing with ID: 1985420
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985420%27 HTTP/1.1" 200 None
2026-03-27 22:52:23 [ayvens.be] INFO: Scrape type for 1985420: 2
2026-03-27 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1985420
2026-03-27 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-27 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 2
2026-03-27 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 2
2026-03-27 22:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e478d88-9255-5fdd-848c-32c5ddc31c17, identifier: 1985420
2026-03-27 22:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-27 22:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-27 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420 to the API
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6e478d88-9255-5fdd-848c-32c5ddc31c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 95069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985420%27 HTTP/1.1" 200 None
2026-03-27 22:52:23 [ayvens.be] INFO: Saving data for 1985420: {'auction_closing_time': 1774958400.0, 'created_time': 1774565472.05927, 'last_price_update_time': 1774651943.614871}
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985420') HTTP/1.1" 204 0
2026-03-27 22:52:23 [ayvens.be] INFO: Found listing with ID: 1985421
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985421%27 HTTP/1.1" 200 None
2026-03-27 22:52:23 [ayvens.be] INFO: Scrape type for 1985421: 2
2026-03-27 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1985421
2026-03-27 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-27 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 2
2026-03-27 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 2
2026-03-27 22:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0597b31-b618-5a7c-9897-7d9733dea90c, identifier: 1985421
2026-03-27 22:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-27 22:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-27 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421 to the API
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0597b31-b618-5a7c-9897-7d9733dea90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 102948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985421%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Saving data for 1985421: {'auction_closing_time': 1774958400.0, 'created_time': 1774565473.324881, 'last_price_update_time': 1774651944.000229}
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985421') HTTP/1.1" 204 0
2026-03-27 22:52:24 [ayvens.be] INFO: Found listing with ID: 1985422
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985422%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Scrape type for 1985422: 2
2026-03-27 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1985422
2026-03-27 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-27 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 2
2026-03-27 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 2
2026-03-27 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10aede45-dc31-5ff5-8678-55acc89a1832, identifier: 1985422
2026-03-27 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-27 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-27 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422 to the API
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '10aede45-dc31-5ff5-8678-55acc89a1832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 106199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985422%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Saving data for 1985422: {'auction_closing_time': 1774958400.0, 'created_time': 1774565474.526966, 'last_price_update_time': 1774651944.394601}
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985422') HTTP/1.1" 204 0
2026-03-27 22:52:24 [ayvens.be] INFO: Found listing with ID: 1985423
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985423%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Scrape type for 1985423: 2
2026-03-27 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1985423
2026-03-27 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-27 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 2
2026-03-27 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 2
2026-03-27 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85823419-bea0-53d2-b46c-8cd10925d2b0, identifier: 1985423
2026-03-27 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-27 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-27 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423 to the API
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '85823419-bea0-53d2-b46c-8cd10925d2b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985423%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Saving data for 1985423: {'auction_closing_time': 1774958400.0, 'created_time': 1774565475.952964, 'last_price_update_time': 1774651944.895096}
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985423') HTTP/1.1" 204 0
2026-03-27 22:52:24 [ayvens.be] INFO: Found listing with ID: 1985424
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985424%27 HTTP/1.1" 200 None
2026-03-27 22:52:24 [ayvens.be] INFO: Scrape type for 1985424: 2
2026-03-27 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1985424
2026-03-27 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-27 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 2
2026-03-27 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 2
2026-03-27 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, identifier: 1985424
2026-03-27 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-27 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-27 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424 to the API
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b5d7ca9d-9d34-50ce-9519-5cb713e3392e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 81688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985424%27 HTTP/1.1" 200 None
2026-03-27 22:52:25 [ayvens.be] INFO: Saving data for 1985424: {'auction_closing_time': 1774958400.0, 'created_time': 1774565477.401135, 'last_price_update_time': 1774651945.333458}
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985424') HTTP/1.1" 204 0
2026-03-27 22:52:25 [ayvens.be] INFO: Found listing with ID: 1985425
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985425%27 HTTP/1.1" 200 None
2026-03-27 22:52:25 [ayvens.be] INFO: Scrape type for 1985425: 2
2026-03-27 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1985425
2026-03-27 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-27 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 2
2026-03-27 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 2
2026-03-27 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d7cf7abd-ce36-549d-ad5b-cb0e608050f4, identifier: 1985425
2026-03-27 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-27 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-27 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425 to the API
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd7cf7abd-ce36-549d-ad5b-cb0e608050f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 152619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985425%27 HTTP/1.1" 200 None
2026-03-27 22:52:25 [ayvens.be] INFO: Saving data for 1985425: {'auction_closing_time': 1774958400.0, 'created_time': 1774565478.993624, 'last_price_update_time': 1774651945.742385}
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985425') HTTP/1.1" 204 0
2026-03-27 22:52:25 [ayvens.be] INFO: Found listing with ID: 1985426
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985426%27 HTTP/1.1" 200 None
2026-03-27 22:52:25 [ayvens.be] INFO: Scrape type for 1985426: 2
2026-03-27 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1985426
2026-03-27 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-27 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 2
2026-03-27 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 2
2026-03-27 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 336ff642-b8c1-548c-a777-d27cc3548c5a, identifier: 1985426
2026-03-27 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-27 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-27 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426 to the API
2026-03-27 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '336ff642-b8c1-548c-a777-d27cc3548c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 52291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO BEV 65KWH NIRO EV 150KW PURE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 65KWH NIRO EV 150KW PURE AUTO',
 'vin': None,
 'year': 2024}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985426%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Saving data for 1985426: {'auction_closing_time': 1774958400.0, 'created_time': 1774565481.122169, 'last_price_update_time': 1774651946.124532}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985426') HTTP/1.1" 204 0
2026-03-27 22:52:26 [ayvens.be] INFO: Found listing with ID: 1985427
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985427%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Scrape type for 1985427: 2
2026-03-27 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1985427
2026-03-27 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-27 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 2
2026-03-27 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 2
2026-03-27 22:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 581e808f-db3d-59b1-ba12-bd1d1e86e005, identifier: 1985427
2026-03-27 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-27 22:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-27 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427 to the API
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '581e808f-db3d-59b1-ba12-bd1d1e86e005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 122577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ALLURE',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985427%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Saving data for 1985427: {'auction_closing_time': 1774958400.0, 'created_time': 1774565482.691453, 'last_price_update_time': 1774651946.509188}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985427') HTTP/1.1" 204 0
2026-03-27 22:52:26 [ayvens.be] INFO: Found listing with ID: 1985428
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985428%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Scrape type for 1985428: 2
2026-03-27 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1985428
2026-03-27 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-27 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 2
2026-03-27 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 2
2026-03-27 22:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 89e6be1e-eb40-5242-8521-e6bba00d5ed3, identifier: 1985428
2026-03-27 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-27 22:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-27 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428 to the API
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '89e6be1e-eb40-5242-8521-e6bba00d5ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 54317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E DCT SHOOTING BRAKE',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E DCT SHOOTING BRAKE',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985428%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Saving data for 1985428: {'auction_closing_time': 1774958400.0, 'created_time': 1774565484.330691, 'last_price_update_time': 1774651946.897874}
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985428') HTTP/1.1" 204 0
2026-03-27 22:52:26 [ayvens.be] INFO: Found listing with ID: 1985429
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985429%27 HTTP/1.1" 200 None
2026-03-27 22:52:26 [ayvens.be] INFO: Scrape type for 1985429: 2
2026-03-27 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1985429
2026-03-27 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-27 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 2
2026-03-27 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 2
2026-03-27 22:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d244416-97dd-5dcf-9229-64139a9fcf6e, identifier: 1985429
2026-03-27 22:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-27 22:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-27 22:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429 to the API
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d244416-97dd-5dcf-9229-64139a9fcf6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI 5 DOOR',
 'odometer': 123903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI 5 DOOR 1.5 ONE',
 'transmission': 'manual',
 'trim': '1.5 ONE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985429%27 HTTP/1.1" 200 None
2026-03-27 22:52:27 [ayvens.be] INFO: Saving data for 1985429: {'auction_closing_time': 1774958400.0, 'created_time': 1774565487.096897, 'last_price_update_time': 1774651947.394884}
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985429') HTTP/1.1" 204 0
2026-03-27 22:52:27 [ayvens.be] INFO: Found listing with ID: 1985430
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985430%27 HTTP/1.1" 200 None
2026-03-27 22:52:27 [ayvens.be] INFO: Scrape type for 1985430: 2
2026-03-27 22:52:27 [ayvens.be] INFO: Extracting data for car ID: 1985430
2026-03-27 22:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-27 22:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51809147-5da6-5336-96a6-dd315c4bbb21 with scrape type 2
2026-03-27 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51809147-5da6-5336-96a6-dd315c4bbb21 with scrape type 2
2026-03-27 22:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51809147-5da6-5336-96a6-dd315c4bbb21, identifier: 1985430
2026-03-27 22:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-27 22:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-27 22:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430 to the API
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '51809147-5da6-5336-96a6-dd315c4bbb21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 157535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985430%27 HTTP/1.1" 200 None
2026-03-27 22:52:27 [ayvens.be] INFO: Saving data for 1985430: {'auction_closing_time': 1774958400.0, 'created_time': 1774565488.329769, 'last_price_update_time': 1774651947.798294}
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985430') HTTP/1.1" 204 0
2026-03-27 22:52:27 [ayvens.be] INFO: Found listing with ID: 1985431
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985431%27 HTTP/1.1" 200 None
2026-03-27 22:52:27 [ayvens.be] INFO: Scrape type for 1985431: 2
2026-03-27 22:52:27 [ayvens.be] INFO: Extracting data for car ID: 1985431
2026-03-27 22:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-27 22:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110543a2-946b-58b5-a399-47a2e5bd84a4 with scrape type 2
2026-03-27 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110543a2-946b-58b5-a399-47a2e5bd84a4 with scrape type 2
2026-03-27 22:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 110543a2-946b-58b5-a399-47a2e5bd84a4, identifier: 1985431
2026-03-27 22:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-27 22:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-27 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431 to the API
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '110543a2-946b-58b5-a399-47a2e5bd84a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 135124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985431%27 HTTP/1.1" 200 None
2026-03-27 22:52:28 [ayvens.be] INFO: Saving data for 1985431: {'auction_closing_time': 1774958400.0, 'created_time': 1774565489.580258, 'last_price_update_time': 1774651948.207372}
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985431') HTTP/1.1" 204 0
2026-03-27 22:52:28 [ayvens.be] INFO: Found listing with ID: 1985432
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985432%27 HTTP/1.1" 200 None
2026-03-27 22:52:28 [ayvens.be] INFO: Scrape type for 1985432: 2
2026-03-27 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1985432
2026-03-27 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-27 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d04549-6880-5772-8780-32ea6fc9f9cf with scrape type 2
2026-03-27 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73d04549-6880-5772-8780-32ea6fc9f9cf with scrape type 2
2026-03-27 22:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73d04549-6880-5772-8780-32ea6fc9f9cf, identifier: 1985432
2026-03-27 22:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-27 22:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-27 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432 to the API
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '73d04549-6880-5772-8780-32ea6fc9f9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 140777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985432%27 HTTP/1.1" 200 None
2026-03-27 22:52:28 [ayvens.be] INFO: Saving data for 1985432: {'auction_closing_time': 1774958400.0, 'created_time': 1774565490.852419, 'last_price_update_time': 1774651948.6426}
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985432') HTTP/1.1" 204 0
2026-03-27 22:52:28 [ayvens.be] INFO: Found listing with ID: 1985433
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985433%27 HTTP/1.1" 200 None
2026-03-27 22:52:28 [ayvens.be] INFO: Scrape type for 1985433: 2
2026-03-27 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1985433
2026-03-27 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-27 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 2
2026-03-27 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 2
2026-03-27 22:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac91607f-a69f-52f7-9c65-c869b70c8f00, identifier: 1985433
2026-03-27 22:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-27 22:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-27 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433 to the API
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ac91607f-a69f-52f7-9c65-c869b70c8f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 40666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S GT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985433%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Saving data for 1985433: {'auction_closing_time': 1774958400.0, 'created_time': 1774565492.695053, 'last_price_update_time': 1774651949.057612}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985433') HTTP/1.1" 204 0
2026-03-27 22:52:29 [ayvens.be] INFO: Found listing with ID: 1985434
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985434%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Scrape type for 1985434: 2
2026-03-27 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1985434
2026-03-27 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-27 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 2
2026-03-27 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 2
2026-03-27 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89, identifier: 1985434
2026-03-27 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-27 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-27 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434 to the API
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0238b4ff-f3fd-56fb-b2ff-97a7b2555e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 154481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Business Edition',
 'transmission': 'automatic',
 'trim': '1.5 Turbo D Business Edition',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985434%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Saving data for 1985434: {'auction_closing_time': 1774958400.0, 'created_time': 1774565494.617457, 'last_price_update_time': 1774651949.536026}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985434') HTTP/1.1" 204 0
2026-03-27 22:52:29 [ayvens.be] INFO: Found listing with ID: 1985435
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985435%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Scrape type for 1985435: 2
2026-03-27 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1985435
2026-03-27 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-27 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 2
2026-03-27 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 2
2026-03-27 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 340005c8-2f01-5331-9c8f-219207504f55, identifier: 1985435
2026-03-27 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-27 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-27 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435 to the API
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '340005c8-2f01-5331-9c8f-219207504f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 102888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985435%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Saving data for 1985435: {'auction_closing_time': 1774958400.0, 'created_time': 1774565496.244024, 'last_price_update_time': 1774651949.934883}
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985435') HTTP/1.1" 204 0
2026-03-27 22:52:29 [ayvens.be] INFO: Found listing with ID: 1985436
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985436%27 HTTP/1.1" 200 None
2026-03-27 22:52:29 [ayvens.be] INFO: Scrape type for 1985436: 2
2026-03-27 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1985436
2026-03-27 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-27 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 2
2026-03-27 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 2
2026-03-27 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736, identifier: 1985436
2026-03-27 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-27 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-27 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436 to the API
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd44b29fe-b0ac-50ce-b5d2-6f0ae726e736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 94681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985436%27 HTTP/1.1" 200 None
2026-03-27 22:52:30 [ayvens.be] INFO: Saving data for 1985436: {'auction_closing_time': 1774958400.0, 'created_time': 1774565498.472771, 'last_price_update_time': 1774651950.346686}
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985436') HTTP/1.1" 204 0
2026-03-27 22:52:30 [ayvens.be] INFO: Found listing with ID: 1985437
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985437%27 HTTP/1.1" 200 None
2026-03-27 22:52:30 [ayvens.be] INFO: Scrape type for 1985437: 2
2026-03-27 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1985437
2026-03-27 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-27 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 2
2026-03-27 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 2
2026-03-27 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fe3a826-d1b0-5341-92c4-687efe5da057, identifier: 1985437
2026-03-27 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-27 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-27 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437 to the API
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fe3a826-d1b0-5341-92c4-687efe5da057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 110648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985437%27 HTTP/1.1" 200 None
2026-03-27 22:52:30 [ayvens.be] INFO: Saving data for 1985437: {'auction_closing_time': 1774958400.0, 'created_time': 1774565499.50325, 'last_price_update_time': 1774651950.73975}
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985437') HTTP/1.1" 204 0
2026-03-27 22:52:30 [ayvens.be] INFO: Found listing with ID: 1985438
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985438%27 HTTP/1.1" 200 None
2026-03-27 22:52:30 [ayvens.be] INFO: Scrape type for 1985438: 2
2026-03-27 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1985438
2026-03-27 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-27 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 2
2026-03-27 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 2
2026-03-27 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4, identifier: 1985438
2026-03-27 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-27 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-27 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438 to the API
2026-03-27 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '9a80622f-dbf6-5ccc-a105-af1847b0b8a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 139128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985438%27 HTTP/1.1" 200 None
2026-03-27 22:52:31 [ayvens.be] INFO: Saving data for 1985438: {'auction_closing_time': 1774958400.0, 'created_time': 1774565501.82198, 'last_price_update_time': 1774651951.360325}
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985438') HTTP/1.1" 204 0
2026-03-27 22:52:31 [ayvens.be] INFO: Found listing with ID: 1985439
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985439%27 HTTP/1.1" 200 None
2026-03-27 22:52:31 [ayvens.be] INFO: Scrape type for 1985439: 2
2026-03-27 22:52:31 [ayvens.be] INFO: Extracting data for car ID: 1985439
2026-03-27 22:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-27 22:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 2
2026-03-27 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 2
2026-03-27 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 433392de-fd62-5a76-88b4-6ae1052541af, identifier: 1985439
2026-03-27 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-27 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-27 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439 to the API
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '433392de-fd62-5a76-88b4-6ae1052541af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 76075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985439%27 HTTP/1.1" 200 None
2026-03-27 22:52:31 [ayvens.be] INFO: Saving data for 1985439: {'auction_closing_time': 1774958400.0, 'created_time': 1774565503.142336, 'last_price_update_time': 1774651951.760704}
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985439') HTTP/1.1" 204 0
2026-03-27 22:52:31 [ayvens.be] INFO: Found listing with ID: 1985440
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985440%27 HTTP/1.1" 200 None
2026-03-27 22:52:31 [ayvens.be] INFO: Scrape type for 1985440: 2
2026-03-27 22:52:31 [ayvens.be] INFO: Extracting data for car ID: 1985440
2026-03-27 22:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-27 22:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 2
2026-03-27 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 2
2026-03-27 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, identifier: 1985440
2026-03-27 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-27 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-27 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440 to the API
2026-03-27 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '27122ce6-6efb-57c3-8ae6-24b13bc4abdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 81085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985440%27 HTTP/1.1" 200 None
2026-03-27 22:52:32 [ayvens.be] INFO: Saving data for 1985440: {'auction_closing_time': 1774958400.0, 'created_time': 1774565504.660343, 'last_price_update_time': 1774651952.171014}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985440') HTTP/1.1" 204 0
2026-03-27 22:52:32 [ayvens.be] INFO: Found listing with ID: 1985441
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985441%27 HTTP/1.1" 200 None
2026-03-27 22:52:32 [ayvens.be] INFO: Scrape type for 1985441: 2
2026-03-27 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1985441
2026-03-27 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-27 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 2
2026-03-27 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 2
2026-03-27 22:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86ace69f-baad-5850-800a-8994805bd9da, identifier: 1985441
2026-03-27 22:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-27 22:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-27 22:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441 to the API
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '86ace69f-baad-5850-800a-8994805bd9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 122499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985441%27 HTTP/1.1" 200 None
2026-03-27 22:52:32 [ayvens.be] INFO: Saving data for 1985441: {'auction_closing_time': 1774958400.0, 'created_time': 1774565507.380706, 'last_price_update_time': 1774651952.569987}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985441') HTTP/1.1" 204 0
2026-03-27 22:52:32 [ayvens.be] INFO: Found listing with ID: 1985442
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985442%27 HTTP/1.1" 200 None
2026-03-27 22:52:32 [ayvens.be] INFO: Scrape type for 1985442: 2
2026-03-27 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1985442
2026-03-27 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-27 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 2
2026-03-27 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 2
2026-03-27 22:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419, identifier: 1985442
2026-03-27 22:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-27 22:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-27 22:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442 to the API
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '13cb0d5c-a1ec-528d-8bd3-8c2a28f16419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 70990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROËN GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985442%27 HTTP/1.1" 200 None
2026-03-27 22:52:32 [ayvens.be] INFO: Saving data for 1985442: {'auction_closing_time': 1774958400.0, 'created_time': 1774565508.093884, 'last_price_update_time': 1774651952.977062}
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985442') HTTP/1.1" 204 0
2026-03-27 22:52:32 [ayvens.be] INFO: Found listing with ID: 1985443
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985443%27 HTTP/1.1" 200 None
2026-03-27 22:52:33 [ayvens.be] INFO: Scrape type for 1985443: 2
2026-03-27 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1985443
2026-03-27 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-27 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f95e3aae-a4af-5899-ae14-85507159c18e, identifier: 1985443
2026-03-27 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-27 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-27 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443 to the API
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f95e3aae-a4af-5899-ae14-85507159c18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 43732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 520E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520E AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985443%27 HTTP/1.1" 200 None
2026-03-27 22:52:33 [ayvens.be] INFO: Saving data for 1985443: {'auction_closing_time': 1774958400.0, 'created_time': 1774565509.473504, 'last_price_update_time': 1774651953.380827}
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985443') HTTP/1.1" 204 0
2026-03-27 22:52:33 [ayvens.be] INFO: Found listing with ID: 1985444
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985444%27 HTTP/1.1" 200 None
2026-03-27 22:52:33 [ayvens.be] INFO: Scrape type for 1985444: 2
2026-03-27 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1985444
2026-03-27 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-27 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68f2489-e4bd-53cf-9df3-8a995c530188, identifier: 1985444
2026-03-27 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-27 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-27 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444 to the API
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b68f2489-e4bd-53cf-9df3-8a995c530188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 73595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985444%27 HTTP/1.1" 200 None
2026-03-27 22:52:33 [ayvens.be] INFO: Saving data for 1985444: {'auction_closing_time': 1774958400.0, 'created_time': 1774565510.772181, 'last_price_update_time': 1774651953.771372}
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985444') HTTP/1.1" 204 0
2026-03-27 22:52:33 [ayvens.be] INFO: Found listing with ID: 1985445
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985445%27 HTTP/1.1" 200 None
2026-03-27 22:52:33 [ayvens.be] INFO: Scrape type for 1985445: 2
2026-03-27 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1985445
2026-03-27 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-27 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 2
2026-03-27 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6, identifier: 1985445
2026-03-27 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-27 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-27 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445 to the API
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ce88cda-37cc-5ed6-9dc9-8eef121d5db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 151110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985445%27 HTTP/1.1" 200 None
2026-03-27 22:52:34 [ayvens.be] INFO: Saving data for 1985445: {'auction_closing_time': 1774958400.0, 'created_time': 1774565512.760206, 'last_price_update_time': 1774651954.249555}
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985445') HTTP/1.1" 204 0
2026-03-27 22:52:34 [ayvens.be] INFO: Found listing with ID: 1985446
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985446%27 HTTP/1.1" 200 None
2026-03-27 22:52:34 [ayvens.be] INFO: Scrape type for 1985446: 2
2026-03-27 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1985446
2026-03-27 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-27 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 2
2026-03-27 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 2
2026-03-27 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e6ba21e-49be-57d2-b325-bc6c4433d37a, identifier: 1985446
2026-03-27 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-27 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-27 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446 to the API
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3e6ba21e-49be-57d2-b325-bc6c4433d37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985446%27 HTTP/1.1" 200 None
2026-03-27 22:52:34 [ayvens.be] INFO: Saving data for 1985446: {'auction_closing_time': 1774958400.0, 'created_time': 1774565514.381879, 'last_price_update_time': 1774651954.690533}
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985446') HTTP/1.1" 204 0
2026-03-27 22:52:34 [ayvens.be] INFO: Found listing with ID: 1985447
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985447%27 HTTP/1.1" 200 None
2026-03-27 22:52:34 [ayvens.be] INFO: Scrape type for 1985447: 2
2026-03-27 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1985447
2026-03-27 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-27 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 2
2026-03-27 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 2
2026-03-27 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c545d7af-3d4a-532c-b476-168ddfe5e144, identifier: 1985447
2026-03-27 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-27 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-27 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447 to the API
2026-03-27 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c545d7af-3d4a-532c-b476-168ddfe5e144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 149690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 STYLE',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 STYLE',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985447%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Saving data for 1985447: {'auction_closing_time': 1774958400.0, 'created_time': 1774565516.033158, 'last_price_update_time': 1774651955.113766}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985447') HTTP/1.1" 204 0
2026-03-27 22:52:35 [ayvens.be] INFO: Found listing with ID: 1985448
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985448%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Scrape type for 1985448: 2
2026-03-27 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1985448
2026-03-27 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-27 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 2
2026-03-27 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 2
2026-03-27 22:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed9de6f2-1704-5a9b-8651-e58841921921, identifier: 1985448
2026-03-27 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-27 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-27 22:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448 to the API
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ed9de6f2-1704-5a9b-8651-e58841921921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 169869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.6 CRTDI 88KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.6 CRTDI 88KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985448%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Saving data for 1985448: {'auction_closing_time': 1774958400.0, 'created_time': 1774565518.003271, 'last_price_update_time': 1774651955.499115}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985448') HTTP/1.1" 204 0
2026-03-27 22:52:35 [ayvens.be] INFO: Found listing with ID: 1985449
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985449%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Scrape type for 1985449: 2
2026-03-27 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1985449
2026-03-27 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-27 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42212df4-538e-5af0-8221-13c8f6d360d4 with scrape type 2
2026-03-27 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42212df4-538e-5af0-8221-13c8f6d360d4 with scrape type 2
2026-03-27 22:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 42212df4-538e-5af0-8221-13c8f6d360d4, identifier: 1985449
2026-03-27 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-27 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-27 22:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449 to the API
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '42212df4-538e-5af0-8221-13c8f6d360d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 16043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.0 MPI 59KW',
 'transmission': 'manual',
 'trim': '1.0 MPI 59KW',
 'vin': None,
 'year': 2024}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985449%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Saving data for 1985449: {'auction_closing_time': 1774958400.0, 'created_time': 1774565519.285394, 'last_price_update_time': 1774651955.886916}
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985449') HTTP/1.1" 204 0
2026-03-27 22:52:35 [ayvens.be] INFO: Found listing with ID: 1985450
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985450%27 HTTP/1.1" 200 None
2026-03-27 22:52:35 [ayvens.be] INFO: Scrape type for 1985450: 2
2026-03-27 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1985450
2026-03-27 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-27 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with scrape type 2
2026-03-27 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with scrape type 2
2026-03-27 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3, identifier: 1985450
2026-03-27 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-27 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-27 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450 to the API
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 62676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985450%27 HTTP/1.1" 200 None
2026-03-27 22:52:36 [ayvens.be] INFO: Saving data for 1985450: {'auction_closing_time': 1774958400.0, 'created_time': 1774565520.976353, 'last_price_update_time': 1774651956.268999}
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985450') HTTP/1.1" 204 0
2026-03-27 22:52:36 [ayvens.be] INFO: Found listing with ID: 1985451
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985451%27 HTTP/1.1" 200 None
2026-03-27 22:52:36 [ayvens.be] INFO: Scrape type for 1985451: 2
2026-03-27 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1985451
2026-03-27 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-27 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with scrape type 2
2026-03-27 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with scrape type 2
2026-03-27 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517, identifier: 1985451
2026-03-27 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-27 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-27 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451 to the API
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '05305e5a-ae85-5ea5-9b7c-4b326ebe5517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 83954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985451%27 HTTP/1.1" 200 None
2026-03-27 22:52:36 [ayvens.be] INFO: Saving data for 1985451: {'auction_closing_time': 1774958400.0, 'created_time': 1774565522.373153, 'last_price_update_time': 1774651956.673442}
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985451') HTTP/1.1" 204 0
2026-03-27 22:52:36 [ayvens.be] INFO: Found listing with ID: 1985452
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985452%27 HTTP/1.1" 200 None
2026-03-27 22:52:36 [ayvens.be] INFO: Scrape type for 1985452: 2
2026-03-27 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1985452
2026-03-27 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-27 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with scrape type 2
2026-03-27 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with scrape type 2
2026-03-27 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a66ca23-9a13-5a20-bf55-db5cde8cb111, identifier: 1985452
2026-03-27 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-27 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-27 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452 to the API
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a66ca23-9a13-5a20-bf55-db5cde8cb111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 195631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 30 TDI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985452%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Saving data for 1985452: {'auction_closing_time': 1774958400.0, 'created_time': 1774565524.329393, 'last_price_update_time': 1774651957.094553}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985452') HTTP/1.1" 204 0
2026-03-27 22:52:37 [ayvens.be] INFO: Found listing with ID: 1985453
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985453%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Scrape type for 1985453: 2
2026-03-27 22:52:37 [ayvens.be] INFO: Extracting data for car ID: 1985453
2026-03-27 22:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-27 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcebad65-19ff-574e-af4a-d5af2b74f1ff with scrape type 2
2026-03-27 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcebad65-19ff-574e-af4a-d5af2b74f1ff with scrape type 2
2026-03-27 22:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcebad65-19ff-574e-af4a-d5af2b74f1ff, identifier: 1985453
2026-03-27 22:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-27 22:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-27 22:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453 to the API
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dcebad65-19ff-574e-af4a-d5af2b74f1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 124094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ADV BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ADV BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985453%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Saving data for 1985453: {'auction_closing_time': 1774958400.0, 'created_time': 1774565525.728824, 'last_price_update_time': 1774651957.513198}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985453') HTTP/1.1" 204 0
2026-03-27 22:52:37 [ayvens.be] INFO: Found listing with ID: 1985454
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985454%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Scrape type for 1985454: 2
2026-03-27 22:52:37 [ayvens.be] INFO: Extracting data for car ID: 1985454
2026-03-27 22:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-27 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419dea60-40ec-58ec-b8a5-92561d4b6c07 with scrape type 2
2026-03-27 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 419dea60-40ec-58ec-b8a5-92561d4b6c07 with scrape type 2
2026-03-27 22:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 419dea60-40ec-58ec-b8a5-92561d4b6c07, identifier: 1985454
2026-03-27 22:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-27 22:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-27 22:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454 to the API
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '419dea60-40ec-58ec-b8a5-92561d4b6c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA - 2020',
 'odometer': 131988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA - 2020 2.5 EcoBoost FWD PHEV ST-Line X',
 'transmission': 'automatic',
 'trim': '2.5 EcoBoost FWD PHEV ST-Line X',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985454%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Saving data for 1985454: {'auction_closing_time': 1774958400.0, 'created_time': 1774565527.337, 'last_price_update_time': 1774651957.895175}
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985454') HTTP/1.1" 204 0
2026-03-27 22:52:37 [ayvens.be] INFO: Found listing with ID: 1985455
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985455%27 HTTP/1.1" 200 None
2026-03-27 22:52:37 [ayvens.be] INFO: Scrape type for 1985455: 2
2026-03-27 22:52:37 [ayvens.be] INFO: Extracting data for car ID: 1985455
2026-03-27 22:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-27 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9971293-22a3-56ba-a1df-35de5b0fe5ea with scrape type 2
2026-03-27 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9971293-22a3-56ba-a1df-35de5b0fe5ea with scrape type 2
2026-03-27 22:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9971293-22a3-56ba-a1df-35de5b0fe5ea, identifier: 1985455
2026-03-27 22:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-27 22:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-27 22:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455 to the API
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c9971293-22a3-56ba-a1df-35de5b0fe5ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 121114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 GT',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985455%27 HTTP/1.1" 200 None
2026-03-27 22:52:38 [ayvens.be] INFO: Saving data for 1985455: {'auction_closing_time': 1774958400.0, 'created_time': 1774565528.741252, 'last_price_update_time': 1774651958.299901}
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985455') HTTP/1.1" 204 0
2026-03-27 22:52:38 [ayvens.be] INFO: Found listing with ID: 1985456
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985456%27 HTTP/1.1" 200 None
2026-03-27 22:52:38 [ayvens.be] INFO: Scrape type for 1985456: 2
2026-03-27 22:52:38 [ayvens.be] INFO: Extracting data for car ID: 1985456
2026-03-27 22:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-27 22:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with scrape type 2
2026-03-27 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with scrape type 2
2026-03-27 22:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f67602dd-81c9-5bdc-a2f5-6c15735b97d6, identifier: 1985456
2026-03-27 22:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-27 22:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-27 22:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456 to the API
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f67602dd-81c9-5bdc-a2f5-6c15735b97d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 173719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985456%27 HTTP/1.1" 200 None
2026-03-27 22:52:38 [ayvens.be] INFO: Saving data for 1985456: {'auction_closing_time': 1774958400.0, 'created_time': 1774565530.522225, 'last_price_update_time': 1774651958.779632}
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985456') HTTP/1.1" 204 0
2026-03-27 22:52:38 [ayvens.be] INFO: Found listing with ID: 1985457
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985457%27 HTTP/1.1" 200 None
2026-03-27 22:52:38 [ayvens.be] INFO: Scrape type for 1985457: 2
2026-03-27 22:52:38 [ayvens.be] INFO: Extracting data for car ID: 1985457
2026-03-27 22:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-27 22:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b7560e-0bef-5b10-a8ae-104759e2bef5 with scrape type 2
2026-03-27 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b7560e-0bef-5b10-a8ae-104759e2bef5 with scrape type 2
2026-03-27 22:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53b7560e-0bef-5b10-a8ae-104759e2bef5, identifier: 1985457
2026-03-27 22:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-27 22:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-27 22:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457 to the API
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '53b7560e-0bef-5b10-a8ae-104759e2bef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A7 SPORTBACK DIESEL - 2018',
 'odometer': 95522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A7 SPORTBACK DIESEL - 2018 40 TDi S tronic',
 'transmission': 'automatic',
 'trim': '40 TDi S tronic',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985457%27 HTTP/1.1" 200 None
2026-03-27 22:52:39 [ayvens.be] INFO: Saving data for 1985457: {'auction_closing_time': 1774958400.0, 'created_time': 1774565532.160085, 'last_price_update_time': 1774651959.208951}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985457') HTTP/1.1" 204 0
2026-03-27 22:52:39 [ayvens.be] INFO: Found listing with ID: 1985458
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985458%27 HTTP/1.1" 200 None
2026-03-27 22:52:39 [ayvens.be] INFO: Scrape type for 1985458: 2
2026-03-27 22:52:39 [ayvens.be] INFO: Extracting data for car ID: 1985458
2026-03-27 22:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-27 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with scrape type 2
2026-03-27 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with scrape type 2
2026-03-27 22:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf, identifier: 1985458
2026-03-27 22:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-27 22:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-27 22:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458 to the API
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 47102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School  Double pedals',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School  Double pedals',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985458%27 HTTP/1.1" 200 None
2026-03-27 22:52:39 [ayvens.be] INFO: Saving data for 1985458: {'auction_closing_time': 1774958400.0, 'created_time': 1774565533.000466, 'last_price_update_time': 1774651959.592921}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985458') HTTP/1.1" 204 0
2026-03-27 22:52:39 [ayvens.be] INFO: Found listing with ID: 1985459
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985459%27 HTTP/1.1" 200 None
2026-03-27 22:52:39 [ayvens.be] INFO: Scrape type for 1985459: 2
2026-03-27 22:52:39 [ayvens.be] INFO: Extracting data for car ID: 1985459
2026-03-27 22:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-27 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ba7fa2-c04d-5732-8472-419439b4e0fc with scrape type 2
2026-03-27 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8ba7fa2-c04d-5732-8472-419439b4e0fc with scrape type 2
2026-03-27 22:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8ba7fa2-c04d-5732-8472-419439b4e0fc, identifier: 1985459
2026-03-27 22:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-27 22:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-27 22:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459 to the API
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a8ba7fa2-c04d-5732-8472-419439b4e0fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 35012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School   Double '
          'pedals',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School   Double pedals',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985459%27 HTTP/1.1" 200 None
2026-03-27 22:52:39 [ayvens.be] INFO: Saving data for 1985459: {'auction_closing_time': 1774958400.0, 'created_time': 1774565534.271781, 'last_price_update_time': 1774651959.97786}
2026-03-27 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985459') HTTP/1.1" 204 0
2026-03-27 22:52:40 [ayvens.be] INFO: Found listing with ID: 1985460
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985460%27 HTTP/1.1" 200 None
2026-03-27 22:52:40 [ayvens.be] INFO: Scrape type for 1985460: 2
2026-03-27 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1985460
2026-03-27 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-27 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50c448c-b647-572e-8107-86e944765fb8 with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d50c448c-b647-572e-8107-86e944765fb8 with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d50c448c-b647-572e-8107-86e944765fb8, identifier: 1985460
2026-03-27 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-27 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-27 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460 to the API
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd50c448c-b647-572e-8107-86e944765fb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 74123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985460%27 HTTP/1.1" 200 None
2026-03-27 22:52:40 [ayvens.be] INFO: Saving data for 1985460: {'auction_closing_time': 1774958400.0, 'created_time': 1774565536.068034, 'last_price_update_time': 1774651960.376561}
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985460') HTTP/1.1" 204 0
2026-03-27 22:52:40 [ayvens.be] INFO: Found listing with ID: 1985461
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985461%27 HTTP/1.1" 200 None
2026-03-27 22:52:40 [ayvens.be] INFO: Scrape type for 1985461: 2
2026-03-27 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1985461
2026-03-27 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-27 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6157f0-92a1-5050-951a-f02475e00dae with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba6157f0-92a1-5050-951a-f02475e00dae with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ba6157f0-92a1-5050-951a-f02475e00dae, identifier: 1985461
2026-03-27 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-27 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-27 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461 to the API
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ba6157f0-92a1-5050-951a-f02475e00dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 78012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985461%27 HTTP/1.1" 200 None
2026-03-27 22:52:40 [ayvens.be] INFO: Saving data for 1985461: {'auction_closing_time': 1774958400.0, 'created_time': 1774565537.363588, 'last_price_update_time': 1774651960.757432}
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985461') HTTP/1.1" 204 0
2026-03-27 22:52:40 [ayvens.be] INFO: Found listing with ID: 1985462
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985462%27 HTTP/1.1" 200 None
2026-03-27 22:52:40 [ayvens.be] INFO: Scrape type for 1985462: 2
2026-03-27 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1985462
2026-03-27 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-27 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a with scrape type 2
2026-03-27 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 614090ff-627e-5a45-ad6b-0bc3cfa2266a, identifier: 1985462
2026-03-27 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-27 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-27 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462 to the API
2026-03-27 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '614090ff-627e-5a45-ad6b-0bc3cfa2266a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985462%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Saving data for 1985462: {'auction_closing_time': 1774958400.0, 'created_time': 1774565538.576166, 'last_price_update_time': 1774651961.1514}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985462') HTTP/1.1" 204 0
2026-03-27 22:52:41 [ayvens.be] INFO: Found listing with ID: 1985463
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985463%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Scrape type for 1985463: 2
2026-03-27 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1985463
2026-03-27 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-27 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d27c44-c77c-505e-93df-2041e7ceec72 with scrape type 2
2026-03-27 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d27c44-c77c-505e-93df-2041e7ceec72 with scrape type 2
2026-03-27 22:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2d27c44-c77c-505e-93df-2041e7ceec72, identifier: 1985463
2026-03-27 22:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-27 22:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-27 22:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463 to the API
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2d27c44-c77c-505e-93df-2041e7ceec72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 61239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 ETSI 81KW S-S MOVE! DSG',
 'transmission': 'automatic',
 'trim': '1.0 ETSI 81KW S-S MOVE! DSG',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985463%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Saving data for 1985463: {'auction_closing_time': 1774958400.0, 'created_time': 1774565540.065063, 'last_price_update_time': 1774651961.52803}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985463') HTTP/1.1" 204 0
2026-03-27 22:52:41 [ayvens.be] INFO: Found listing with ID: 1985464
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985464%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Scrape type for 1985464: 2
2026-03-27 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1985464
2026-03-27 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-27 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with scrape type 2
2026-03-27 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with scrape type 2
2026-03-27 22:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0aec5da-22aa-5563-bf01-bf7b6c9c5160, identifier: 1985464
2026-03-27 22:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-27 22:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-27 22:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464 to the API
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0aec5da-22aa-5563-bf01-bf7b6c9c5160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 83978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985464%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Saving data for 1985464: {'auction_closing_time': 1774958400.0, 'created_time': 1774565541.448145, 'last_price_update_time': 1774651961.914143}
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985464') HTTP/1.1" 204 0
2026-03-27 22:52:41 [ayvens.be] INFO: Found listing with ID: 1985465
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985465%27 HTTP/1.1" 200 None
2026-03-27 22:52:41 [ayvens.be] INFO: Scrape type for 1985465: 2
2026-03-27 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1985465
2026-03-27 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-27 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3efe363-6c49-5207-84ad-6fdd8285a0ba with scrape type 2
2026-03-27 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3efe363-6c49-5207-84ad-6fdd8285a0ba with scrape type 2
2026-03-27 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3efe363-6c49-5207-84ad-6fdd8285a0ba, identifier: 1985465
2026-03-27 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-27 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-27 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465 to the API
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3efe363-6c49-5207-84ad-6fdd8285a0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985465%27 HTTP/1.1" 200 None
2026-03-27 22:52:42 [ayvens.be] INFO: Saving data for 1985465: {'auction_closing_time': 1774958400.0, 'created_time': 1774565543.920968, 'last_price_update_time': 1774651962.302752}
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985465') HTTP/1.1" 204 0
2026-03-27 22:52:42 [ayvens.be] INFO: Found listing with ID: 1985466
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985466%27 HTTP/1.1" 200 None
2026-03-27 22:52:42 [ayvens.be] INFO: Scrape type for 1985466: 2
2026-03-27 22:52:42 [ayvens.be] INFO: Extracting data for car ID: 1985466
2026-03-27 22:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-27 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 2
2026-03-27 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 2
2026-03-27 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a584356-5629-50b3-a6ac-7d347cf34300, identifier: 1985466
2026-03-27 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-27 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-27 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466 to the API
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3a584356-5629-50b3-a6ac-7d347cf34300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 94794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985466%27 HTTP/1.1" 200 None
2026-03-27 22:52:42 [ayvens.be] INFO: Saving data for 1985466: {'auction_closing_time': 1774958400.0, 'created_time': 1774565545.318801, 'last_price_update_time': 1774651962.692496}
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985466') HTTP/1.1" 204 0
2026-03-27 22:52:42 [ayvens.be] INFO: Found listing with ID: 1985467
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985467%27 HTTP/1.1" 200 None
2026-03-27 22:52:42 [ayvens.be] INFO: Scrape type for 1985467: 2
2026-03-27 22:52:42 [ayvens.be] INFO: Extracting data for car ID: 1985467
2026-03-27 22:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-27 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 2
2026-03-27 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 2
2026-03-27 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1633be65-fc75-5ecc-9ded-a75cce69d482, identifier: 1985467
2026-03-27 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-27 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-27 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467 to the API
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1633be65-fc75-5ecc-9ded-a75cce69d482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 82439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985467%27 HTTP/1.1" 200 None
2026-03-27 22:52:43 [ayvens.be] INFO: Saving data for 1985467: {'auction_closing_time': 1774958400.0, 'created_time': 1774565546.581144, 'last_price_update_time': 1774651963.176469}
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985467') HTTP/1.1" 204 0
2026-03-27 22:52:43 [ayvens.be] INFO: Found listing with ID: 1985468
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985468%27 HTTP/1.1" 200 None
2026-03-27 22:52:43 [ayvens.be] INFO: Scrape type for 1985468: 2
2026-03-27 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1985468
2026-03-27 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-27 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 2
2026-03-27 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 2
2026-03-27 22:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69645680-dd88-54d6-bb22-6e98fa48909c, identifier: 1985468
2026-03-27 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-27 22:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-27 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468 to the API
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '69645680-dd88-54d6-bb22-6e98fa48909c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 98878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 200KW XDRIVE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 200KW XDRIVE AUTO',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985468%27 HTTP/1.1" 200 None
2026-03-27 22:52:43 [ayvens.be] INFO: Saving data for 1985468: {'auction_closing_time': 1774958400.0, 'created_time': 1774565548.411986, 'last_price_update_time': 1774651963.569636}
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985468') HTTP/1.1" 204 0
2026-03-27 22:52:43 [ayvens.be] INFO: Found listing with ID: 1985469
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985469%27 HTTP/1.1" 200 None
2026-03-27 22:52:43 [ayvens.be] INFO: Scrape type for 1985469: 2
2026-03-27 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1985469
2026-03-27 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-27 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 2
2026-03-27 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 2
2026-03-27 22:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, identifier: 1985469
2026-03-27 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-27 22:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-27 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469 to the API
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8580ac67-a34c-5f62-8fe2-1d5c6cfeef19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 150736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985469%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Saving data for 1985469: {'auction_closing_time': 1774958400.0, 'created_time': 1774565550.267904, 'last_price_update_time': 1774651964.001877}
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985469') HTTP/1.1" 204 0
2026-03-27 22:52:44 [ayvens.be] INFO: Found listing with ID: 1985470
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985470%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Scrape type for 1985470: 2
2026-03-27 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1985470
2026-03-27 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-27 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b18b9c8-f038-5154-8774-01efdde72620, identifier: 1985470
2026-03-27 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-27 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-27 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470 to the API
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2b18b9c8-f038-5154-8774-01efdde72620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 52411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985470%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Saving data for 1985470: {'auction_closing_time': 1774958400.0, 'created_time': 1774565551.692874, 'last_price_update_time': 1774651964.386845}
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985470') HTTP/1.1" 204 0
2026-03-27 22:52:44 [ayvens.be] INFO: Found listing with ID: 1985471
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985471%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Scrape type for 1985471: 2
2026-03-27 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1985471
2026-03-27 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-27 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91c64d60-2a63-590b-be74-1f96dd9673c1, identifier: 1985471
2026-03-27 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-27 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-27 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471 to the API
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '91c64d60-2a63-590b-be74-1f96dd9673c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 117173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985471%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Saving data for 1985471: {'auction_closing_time': 1774958400.0, 'created_time': 1774565553.566298, 'last_price_update_time': 1774651964.773045}
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985471') HTTP/1.1" 204 0
2026-03-27 22:52:44 [ayvens.be] INFO: Found listing with ID: 1985472
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985472%27 HTTP/1.1" 200 None
2026-03-27 22:52:44 [ayvens.be] INFO: Scrape type for 1985472: 2
2026-03-27 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1985472
2026-03-27 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-27 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 2
2026-03-27 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a224006a-ecb1-5777-9c36-19cb2bd63777, identifier: 1985472
2026-03-27 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-27 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-27 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472 to the API
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a224006a-ecb1-5777-9c36-19cb2bd63777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 80986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985472%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Saving data for 1985472: {'auction_closing_time': 1774958400.0, 'created_time': 1774565554.968583, 'last_price_update_time': 1774651965.190148}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985472') HTTP/1.1" 204 0
2026-03-27 22:52:45 [ayvens.be] INFO: Found listing with ID: 1985473
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985473%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Scrape type for 1985473: 2
2026-03-27 22:52:45 [ayvens.be] INFO: Extracting data for car ID: 1985473
2026-03-27 22:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-27 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 2
2026-03-27 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 2
2026-03-27 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, identifier: 1985473
2026-03-27 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-27 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-27 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473 to the API
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8a785fe-b5d0-56fa-83f9-4fab89d7a362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985473%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Saving data for 1985473: {'auction_closing_time': 1774958400.0, 'created_time': 1774565560.845004, 'last_price_update_time': 1774651965.563702}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985473') HTTP/1.1" 204 0
2026-03-27 22:52:45 [ayvens.be] INFO: Found listing with ID: 1985474
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985474%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Scrape type for 1985474: 2
2026-03-27 22:52:45 [ayvens.be] INFO: Extracting data for car ID: 1985474
2026-03-27 22:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-27 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 2
2026-03-27 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 2
2026-03-27 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4cda1ee7-067d-5b55-a37f-ab40174ad128, identifier: 1985474
2026-03-27 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-27 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-27 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474 to the API
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4cda1ee7-067d-5b55-a37f-ab40174ad128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985474%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Saving data for 1985474: {'auction_closing_time': 1774958400.0, 'created_time': 1774565557.772481, 'last_price_update_time': 1774651965.953429}
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985474') HTTP/1.1" 204 0
2026-03-27 22:52:45 [ayvens.be] INFO: Found listing with ID: 1985475
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985475%27 HTTP/1.1" 200 None
2026-03-27 22:52:45 [ayvens.be] INFO: Scrape type for 1985475: 2
2026-03-27 22:52:45 [ayvens.be] INFO: Extracting data for car ID: 1985475
2026-03-27 22:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-27 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 2
2026-03-27 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 2
2026-03-27 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac3f7c41-dc83-5791-8842-4fd94dd6637f, identifier: 1985475
2026-03-27 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-27 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-27 22:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475 to the API
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'COSMOSZWART',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ac3f7c41-dc83-5791-8842-4fd94dd6637f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 120855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 A 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985475%27 HTTP/1.1" 200 None
2026-03-27 22:52:46 [ayvens.be] INFO: Saving data for 1985475: {'auction_closing_time': 1774958400.0, 'created_time': 1774565559.062894, 'last_price_update_time': 1774651966.400297}
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985475') HTTP/1.1" 204 0
2026-03-27 22:52:46 [ayvens.be] INFO: Found listing with ID: 1985476
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985476%27 HTTP/1.1" 200 None
2026-03-27 22:52:46 [ayvens.be] INFO: Scrape type for 1985476: 2
2026-03-27 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1985476
2026-03-27 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-27 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 2
2026-03-27 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 2
2026-03-27 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 923415d3-d6d4-571e-8e07-9b822810782d, identifier: 1985476
2026-03-27 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-27 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-27 22:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476 to the API
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '923415d3-d6d4-571e-8e07-9b822810782d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 118063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985476%27 HTTP/1.1" 200 None
2026-03-27 22:52:46 [ayvens.be] INFO: Saving data for 1985476: {'auction_closing_time': 1774958400.0, 'created_time': 1774565560.346578, 'last_price_update_time': 1774651966.80174}
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985476') HTTP/1.1" 204 0
2026-03-27 22:52:46 [ayvens.be] INFO: Found listing with ID: 1985477
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985477%27 HTTP/1.1" 200 None
2026-03-27 22:52:46 [ayvens.be] INFO: Scrape type for 1985477: 2
2026-03-27 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1985477
2026-03-27 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-27 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 2
2026-03-27 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 2
2026-03-27 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, identifier: 1985477
2026-03-27 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-27 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-27 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477 to the API
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a2e04f41-d376-5af6-88b1-4d1b9319a3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 78299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985477%27 HTTP/1.1" 200 None
2026-03-27 22:52:47 [ayvens.be] INFO: Saving data for 1985477: {'auction_closing_time': 1774958400.0, 'created_time': 1774565563.543636, 'last_price_update_time': 1774651967.213047}
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985477') HTTP/1.1" 204 0
2026-03-27 22:52:47 [ayvens.be] INFO: Found listing with ID: 1985478
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985478%27 HTTP/1.1" 200 None
2026-03-27 22:52:47 [ayvens.be] INFO: Scrape type for 1985478: 2
2026-03-27 22:52:47 [ayvens.be] INFO: Extracting data for car ID: 1985478
2026-03-27 22:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-27 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 2
2026-03-27 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 2
2026-03-27 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e48b0d-73c6-561d-946b-a94fc8b7222f, identifier: 1985478
2026-03-27 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-27 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-27 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478 to the API
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70e48b0d-73c6-561d-946b-a94fc8b7222f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 49781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985478%27 HTTP/1.1" 200 None
2026-03-27 22:52:47 [ayvens.be] INFO: Saving data for 1985478: {'auction_closing_time': 1774958400.0, 'created_time': 1774565564.484065, 'last_price_update_time': 1774651967.705456}
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985478') HTTP/1.1" 204 0
2026-03-27 22:52:47 [ayvens.be] INFO: Found listing with ID: 1985479
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985479%27 HTTP/1.1" 200 None
2026-03-27 22:52:47 [ayvens.be] INFO: Scrape type for 1985479: 2
2026-03-27 22:52:47 [ayvens.be] INFO: Extracting data for car ID: 1985479
2026-03-27 22:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-27 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 2
2026-03-27 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 2
2026-03-27 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, identifier: 1985479
2026-03-27 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-27 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-27 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479 to the API
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 116744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985479%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Saving data for 1985479: {'auction_closing_time': 1774958400.0, 'created_time': 1774565566.033916, 'last_price_update_time': 1774651968.104184}
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985479') HTTP/1.1" 204 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985480
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985480%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985480: 2
2026-03-27 22:52:48 [ayvens.be] INFO: Extracting data for car ID: 1985480
2026-03-27 22:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-27 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 2
2026-03-27 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 2
2026-03-27 22:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6fbcad31-cd3d-5d96-a553-22221415efe3, identifier: 1985480
2026-03-27 22:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-27 22:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-27 22:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480 to the API
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 22:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6fbcad31-cd3d-5d96-a553-22221415efe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Santa Fe',
 'odometer': 122389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Santa Fe 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985480%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Saving data for 1985480: {'auction_closing_time': 1774958400.0, 'created_time': 1774565567.878744, 'last_price_update_time': 1774651968.488791}
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985480') HTTP/1.1" 204 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985481
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985481%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985481: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985482
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985482%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985482: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985483
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985483%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985483: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985484
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985484%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985484: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985485
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985485%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985485: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985486
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985486%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985486: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985487
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985487%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985487: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985488
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985488%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985488: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985489
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985489%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985489: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985490
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985490%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985490: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985491
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985491%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985491: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985492
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985492%27 HTTP/1.1" 200 None
2026-03-27 22:52:48 [ayvens.be] INFO: Scrape type for 1985492: 0
2026-03-27 22:52:48 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-03-27 22:52:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985493
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985493%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985493: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985494
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985494%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985494: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985495
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985495%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985495: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985496
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985496%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985496: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985497
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985497%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985497: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985498
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985498%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985498: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985499
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985499%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985499: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985500
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985500%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985500: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985501
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985501%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985501: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985502
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985502%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985502: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985503
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985503%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985503: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985504
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985504%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985504: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985505
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985505%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985505: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985506
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985506%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985506: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985507
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985507%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985507: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985508
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985508%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985508: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985509
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985509%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985509: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985510
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985510%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985510: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985511
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985511%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985511: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985512
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985512%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985512: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985513
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985513%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985513: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985514
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985514%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985514: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985515
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985515%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985515: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985516
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985516%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985516: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985517
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985517%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985517: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985518
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985518%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985518: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985519
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985519%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985519: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985520
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985520%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985520: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985521
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985521%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985521: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985522
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985522%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985522: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985523
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985523%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985523: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985524
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985524%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985524: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985525
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985525%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985525: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985526
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985526%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985526: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985527
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985527%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985527: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985528
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985528%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985528: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985529
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985529%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985529: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985530
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985530%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985530: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985531
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985531%27 HTTP/1.1" 200 None
2026-03-27 22:52:51 [ayvens.be] INFO: Scrape type for 1985531: 0
2026-03-27 22:52:51 [ayvens.be] INFO: Found listing with ID: 1985532
2026-03-27 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985532%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985532: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985533
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985533%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985533: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985534
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985534%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985534: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985535
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985535%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985535: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985536
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985536%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985536: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985537
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985537%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985537: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985538
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985538%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985538: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985539
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985539%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985539: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985540
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985540%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985540: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985541
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985541%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985541: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985542
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985542%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985542: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985543
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985543%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985543: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985544
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985544%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985544: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985545
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985545%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985545: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985546
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985546%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985546: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985547
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985547%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985547: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985548
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985548%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985548: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985549
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985549%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985549: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985550
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985550%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985550: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985551
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985551%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985551: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985552
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985552%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985552: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985553
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985553%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985553: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985554
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985554%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985554: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985555
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985555%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985555: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985556
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985556%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985556: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985557
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985557%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985557: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985558
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985558%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985558: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985559
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985559%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985559: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985560
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985560%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985560: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985561
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985561%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985561: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985562
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985562%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985562: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985563
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985563%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985563: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985564
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985564%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985564: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985565
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985565%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985565: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985566
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985566%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985566: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985567
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985567%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985567: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985568
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985568%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985568: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985569
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985569%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985569: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985570
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985570%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985570: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985571
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985571%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985571: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985572
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985572%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985572: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985573
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985573%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985573: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985574
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985574%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985574: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985575
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985575%27 HTTP/1.1" 200 None
2026-03-27 22:52:52 [ayvens.be] INFO: Scrape type for 1985575: 0
2026-03-27 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985576
2026-03-27 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985576%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985576: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985577
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985577%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985577: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985578
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985578%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985578: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985579
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985579%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985579: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985580
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985580%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985580: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985581
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985581%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985581: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985582
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985582%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985582: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985583
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985583%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985583: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985584
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985584%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985584: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985585
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985585%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985585: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985586
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985586%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985586: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985587
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985587%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985587: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985588
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985588%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985588: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985589
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985589%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985589: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985590
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985590%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985590: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985591
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985591%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985591: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985592
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985592%27 HTTP/1.1" 200 None
2026-03-27 22:52:53 [ayvens.be] INFO: Scrape type for 1985592: 0
2026-03-27 22:52:53 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-03-27 22:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985593
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985593%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985593: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985594
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985594%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985594: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985595
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985595%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985595: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985596
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985596%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985596: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985597
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985597%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985597: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985598
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985598%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985598: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985599
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985599%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985599: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985600
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985600%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985600: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985601
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985601%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985601: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985602
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985602%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985602: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985603
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985603%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985603: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985604
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985604%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985604: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985605
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985605%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985605: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985606
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985606%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985606: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985607
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985607%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985607: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985608
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985608%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985608: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985609
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985609%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985609: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985610
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985610%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985610: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985611
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985611%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985611: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985612
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985612%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985612: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985613
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985613%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985613: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985614
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985614%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985614: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985615
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985615%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985615: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985616
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985616%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985616: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985617
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985617%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985617: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985618
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985618%27 HTTP/1.1" 200 None
2026-03-27 22:52:55 [ayvens.be] INFO: Scrape type for 1985618: 0
2026-03-27 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985619
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985619%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985619: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985620
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985620%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985620: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985621
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985621%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985621: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985622
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985622%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985622: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985623
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985623%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985623: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985624
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985624%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985624: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985625
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985625%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985625: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985626
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985626%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985626: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985627
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985627%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985627: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985628
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985628%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985628: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985629
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985629%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985629: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985630
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985630%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985630: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985631
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985631%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985631: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985632
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985632%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985632: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985633
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985633%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985633: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985634
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985634%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985634: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985635
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985635%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985635: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985636
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985636%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985636: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985637
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985637%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985637: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985638
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985638%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985638: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985639
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985639%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985639: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985640
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985640%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985640: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985641
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985641%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985641: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985642
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985642%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985642: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985643
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985643%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985643: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985644
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985644%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985644: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985645
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985645%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985645: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985646
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985646%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985646: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985647
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985647%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985647: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985648
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985648%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985648: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985649
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985649%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985649: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985650
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985650%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985650: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985651
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985651%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985651: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985652
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985652%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985652: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985653
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985653%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985653: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985654
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985654%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985654: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985655
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985655%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985655: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985656
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985656%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985656: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985657
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985657%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985657: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985658
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985658%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985658: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985659
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985659%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985659: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985660
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985660%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985660: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985661
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985661%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985661: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985662
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985662%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985662: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985663
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985663%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985663: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985664
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985664%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985664: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985665
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985665%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985665: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985666
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985666%27 HTTP/1.1" 200 None
2026-03-27 22:52:56 [ayvens.be] INFO: Scrape type for 1985666: 0
2026-03-27 22:52:56 [ayvens.be] INFO: Found listing with ID: 1985667
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985667%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985667: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985668
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985668%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985668: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985669
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985669%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985669: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985670
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985670%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985670: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985671
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985671%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985671: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985672
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985672%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985672: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985673
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985673%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985673: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985674
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985674%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985674: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985675
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985675%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985675: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985676
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985676%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985676: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985677
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985677%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985677: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985678
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985678%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985678: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985679
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985679%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985679: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985680
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985680%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985680: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985681
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985681%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985681: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985682
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985682%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985682: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985683
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985683%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985683: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985684
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985684%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985684: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985685
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985685%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985685: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985686
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985686%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985686: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985687
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985687%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985687: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985688
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985688%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985688: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985689
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985689%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985689: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985690
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985690%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985690: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985691
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985691%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1985691: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Found listing with ID: 1982329
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982329%27 HTTP/1.1" 200 None
2026-03-27 22:52:57 [ayvens.be] INFO: Scrape type for 1982329: 0
2026-03-27 22:52:57 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-03-27 22:52:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982330
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982330%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982330: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982331
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982331%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982331: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982332
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982332%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982332: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982333
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982333%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982333: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982334
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982334%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982334: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982335
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982335%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982335: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982336
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982336%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982336: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982337
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982337%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982337: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982338
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982338%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982338: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982339
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982339%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982339: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982340
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982340%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982340: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982341
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982341%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982341: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982342
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982342%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982342: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982343
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982343%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982343: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982344
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982344%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982344: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982345
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982345%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982345: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982346
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982346%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982346: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982347
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982347%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982347: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982348
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982348%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982348: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982349
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982349%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982349: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982350
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982350%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982350: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982351
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982351%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982351: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982352
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982352%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982352: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982353
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982353%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982353: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982354
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982354%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982354: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982355
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982355%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982355: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982356
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982356%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982356: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982357
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982357%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982357: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982358
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982358%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982358: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982359
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982359%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982359: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982360
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982360%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982360: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982361
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982361%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982361: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982362
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982362%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982362: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982363
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982363%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982363: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982364
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982364%27 HTTP/1.1" 200 None
2026-03-27 22:52:59 [ayvens.be] INFO: Scrape type for 1982364: 0
2026-03-27 22:52:59 [ayvens.be] INFO: Found listing with ID: 1982365
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982365%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982365: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982366
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982366%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982366: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982367
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982367%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982367: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982368
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982368%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982368: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982369
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982369%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982369: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982370
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982370%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982370: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982371
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982371%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982371: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982372
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982372%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982372: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982373
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982373%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982373: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982374
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982374%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982374: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982375
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982375%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982375: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982376
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982376%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982376: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982377
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982377%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982377: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982378
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982378%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982378: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982379
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982379%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982379: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982380
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982380%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982380: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982382
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982382%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982382: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982383
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982383%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982383: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982384
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982384%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982384: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982385
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982385%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982385: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982386
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982386%27 HTTP/1.1" 200 None
2026-03-27 22:53:00 [ayvens.be] INFO: Scrape type for 1982386: 0
2026-03-27 22:53:00 [ayvens.be] INFO: Found listing with ID: 1982387
2026-03-27 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982387%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982387: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982388
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982388%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982388: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982389
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982389%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982389: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982390
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982390%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982390: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982391
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982391%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982391: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982392
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982392%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982392: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982393
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982393%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982393: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982394
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982394%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982394: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982395
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982395%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982395: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982396
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982396%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982396: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982397
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982397%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982397: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982398
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982398%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982398: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982399
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982399%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982399: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982400
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982400%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982400: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982401
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982401%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982401: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982402
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982402%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982402: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982403
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982403%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982403: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982404
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982404%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982404: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982405
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982405%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982405: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982406
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982406%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982406: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982407
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982407%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982407: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982408
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982408%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982408: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982409
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982409%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982409: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982410
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982410%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982410: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982411
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982411%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982411: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982412
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982412%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982412: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982413
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982413%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982413: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982414
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982414%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982414: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982415
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982415%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982415: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982416
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982416%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982416: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982417
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982417%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982417: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982418
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982418%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982418: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982419
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982419%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982419: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982420
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982420%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982420: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982421
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982421%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982421: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982422
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982422%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982422: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982423
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982423%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982423: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982424
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982424%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982424: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982425
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982425%27 HTTP/1.1" 200 None
2026-03-27 22:53:01 [ayvens.be] INFO: Scrape type for 1982425: 0
2026-03-27 22:53:01 [ayvens.be] INFO: Found listing with ID: 1982426
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982426%27 HTTP/1.1" 200 None
2026-03-27 22:53:02 [ayvens.be] INFO: Scrape type for 1982426: 0
2026-03-27 22:53:02 [ayvens.be] INFO: Found listing with ID: 1982427
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982427%27 HTTP/1.1" 200 None
2026-03-27 22:53:02 [ayvens.be] INFO: Scrape type for 1982427: 0
2026-03-27 22:53:02 [ayvens.be] INFO: Found listing with ID: 1982428
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982428%27 HTTP/1.1" 200 None
2026-03-27 22:53:02 [ayvens.be] INFO: Scrape type for 1982428: 0
2026-03-27 22:53:02 [ayvens.be] INFO: Found listing with ID: 1982429
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982429%27 HTTP/1.1" 200 None
2026-03-27 22:53:02 [ayvens.be] INFO: Scrape type for 1982429: 0
2026-03-27 22:53:02 [ayvens.be] INFO: Found listing with ID: 1982430
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982430%27 HTTP/1.1" 200 None
2026-03-27 22:53:02 [ayvens.be] INFO: Scrape type for 1982430: 0
2026-03-27 22:53:02 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 900
2026-03-27 22:53:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982431
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982431%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982431: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982432
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982432%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982432: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982433
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982433%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982433: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982434
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982434%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982434: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982435
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982435%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982435: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982436
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982436%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982436: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982437
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982437%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982437: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982438
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982438%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982438: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982439
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982439%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982439: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982440
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982440%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982440: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982441
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982441%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982441: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982442
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982442%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982442: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982443
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982443%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982443: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982444
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982444%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982444: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982445
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982445%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982445: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982446
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982446%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982446: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982447
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982447%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982447: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982448
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982448%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982448: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982449
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982449%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982449: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982450
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982450%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982450: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982451
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982451%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982451: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982452
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982452%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982452: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982453
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982453%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982453: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982454
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982454%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982454: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982455
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982455%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982455: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982456
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982456%27 HTTP/1.1" 200 None
2026-03-27 22:53:05 [ayvens.be] INFO: Scrape type for 1982456: 0
2026-03-27 22:53:05 [ayvens.be] INFO: Found listing with ID: 1982457
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982457%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982457: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982458
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982458%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982458: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982459
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982459%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982459: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982460
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982460%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982460: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982461
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982461%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982461: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982462
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982462%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982462: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982463
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982463%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982463: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982464
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982464%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982464: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982465
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982465%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982465: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982466
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982466%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982466: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982467
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982467%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982467: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982468
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982468%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982468: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982469
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982469%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982469: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982470
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982470%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982470: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982471
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982471%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982471: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982472
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982472%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982472: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982473
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982473%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982473: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982474
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982474%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982474: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982475
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982475%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982475: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982476
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982476%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982476: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982477
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982477%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982477: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982478
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982478%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982478: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982479
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982479%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982479: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982480
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982480%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982480: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982481
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982481%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982481: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982482
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982482%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982482: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982483
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982483%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982483: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982484
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982484%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982484: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982485
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982485%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982485: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982486
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982486%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982486: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982487
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982487%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982487: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982488
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982488%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982488: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982489
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982489%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982489: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982490
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982490%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982490: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1982491
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982491%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1982491: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981135
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981135: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981136
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981136: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981137
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981137: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981138
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981138: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981139
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981139: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981140
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981140: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981141
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981141: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981142
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981142: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981143
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981143: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981144
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981144: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981145
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981145: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981146
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981146: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981147
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981147: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981148
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981148: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981149
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981149: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981150
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981150: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981151
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-27 22:53:06 [ayvens.be] INFO: Scrape type for 1981151: 0
2026-03-27 22:53:06 [ayvens.be] INFO: Found listing with ID: 1981152
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981152: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981153
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981153: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981154
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981154: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981155
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981155: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981156
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981156: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981157
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981157: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981158
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981158: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981159
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981159: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981160
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981160: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981161
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981161: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981162
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981162: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981163
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981163: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981164
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981164: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981165
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981165: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981166
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981166: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981167
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981167: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981168
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981168: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981169
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981169: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981170
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981170: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981171
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981171: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981172
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981172: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Found listing with ID: 1981173
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-27 22:53:07 [ayvens.be] INFO: Scrape type for 1981173: 0
2026-03-27 22:53:07 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1000
2026-03-27 22:53:07 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 5 pages/min), scraped 463 items (at 96 items/min)
2026-03-27 22:53:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 22:53:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981174
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981174: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981175
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981175: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981176
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981176: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981177
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981177: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981178
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981178: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981179
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981179: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981180
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981180: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981181
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981181: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981182
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981182: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981183
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981183: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981184
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981184: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981185
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-27 22:53:09 [ayvens.be] INFO: Scrape type for 1981185: 0
2026-03-27 22:53:09 [ayvens.be] INFO: Found listing with ID: 1981186
2026-03-27 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981186: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981187
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981187: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981188
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981188: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981189
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981189: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981190
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981190: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981191
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981191: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981192
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981192: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981193
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981193: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981194
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981194: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981195
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981195: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981196
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981196: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981197
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981197: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981198
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981198: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981199
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981199: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981200
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981200: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981201
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981201: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981202
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981202: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981203
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981203: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981204
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981204: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981205
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981205: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981206
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981206: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981207
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981207: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981208
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981208: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981209
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981209: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981210
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981210: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981211
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981211: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981212
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981212: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981213
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981213: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981214
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981214: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981215
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981215: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981216
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981216: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981217
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981217: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981218
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981218: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981219
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981219: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981220
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981220: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981221
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981221: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981222
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981222: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981223
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981223: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981224
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981224: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981225
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981225: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1981226
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1981226: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978467
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1978467: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978468
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1978468: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978469
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1978469: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978470
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1978470: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978471
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-27 22:53:10 [ayvens.be] INFO: Scrape type for 1978471: 0
2026-03-27 22:53:10 [ayvens.be] INFO: Found listing with ID: 1978472
2026-03-27 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978472: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978473
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978473: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978474
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978474: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978475
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978475: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978476
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978476: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978477
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978477: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978478
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978478: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978479
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978479: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978480
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978480: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978481
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978481: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978482
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978482: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978483
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978483: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978484
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978484: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978485
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978485: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978486
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978486: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978487
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978487: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978488
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978488: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978489
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978489: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978490
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978490: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978491
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978491: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978492
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978492: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978493
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978493: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978494
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978494: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978495
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978495: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978496
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978496: 0
2026-03-27 22:53:11 [ayvens.be] INFO: Found listing with ID: 1978497
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-27 22:53:11 [ayvens.be] INFO: Scrape type for 1978497: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978498
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978498: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978499
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978499: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978500
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978500: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978501
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978501: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978502
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978502: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978503
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978503: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978504
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978504: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978505
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978505: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978506
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978506: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978507
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978507: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978508
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978508: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978509
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978509: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978510
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978510: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978511
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978511: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978512
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978512: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Found listing with ID: 1978513
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-27 22:53:12 [ayvens.be] INFO: Scrape type for 1978513: 0
2026-03-27 22:53:12 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1100
2026-03-27 22:53:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978514
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978514: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978515
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978515: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978516
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978516: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978517
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978517: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978518
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978518: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978519
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978519: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978520
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978520: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978521
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978521: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978522
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978522: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978523
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978523: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978524
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978524: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978525
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978525: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978526
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978526: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978527
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978527: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978528
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978528: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978529
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978529: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978530
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978530: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978531
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978531: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Found listing with ID: 1978532
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-27 22:53:14 [ayvens.be] INFO: Scrape type for 1978532: 0
2026-03-27 22:53:14 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1200
2026-03-27 22:53:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 22:53:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 22:53:15 [ayvens.be] INFO: ayvens.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 531, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20last_price_update_time%20lt%201774219996 HTTP/1.1" 200 None
2026-03-27 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973083') HTTP/1.1" 204 0
2026-03-27 22:53:16 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (463 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.be/task_34_2026-03-27T22_45_00.jl
2026-03-27 22:53:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 175,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 175,
 'downloader/request_bytes': 954598,
 'downloader/request_count': 2034,
 'downloader/request_method_count/GET': 2021,
 'downloader/request_method_count/POST': 13,
 'downloader/response_bytes': 937995373,
 'downloader/response_count': 1859,
 'downloader/response_status_count/200': 1859,
 'elapsed_time_seconds': 489.295178,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 22, 53, 16, 143920, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 463,
 'log_count/DEBUG': 19494,
 'log_count/INFO': 19945,
 'memusage/max': 194084864,
 'memusage/startup': 150089728,
 'photo_download_count': 1845,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 164,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 155,
 'playwright/request_count/method/POST': 9,
 'playwright/request_count/navigation': 5,
 'playwright/request_count/resource_type/document': 5,
 'playwright/request_count/resource_type/fetch': 10,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 38,
 'playwright/request_count/resource_type/other': 1,
 'playwright/request_count/resource_type/script': 88,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 145,
 'playwright/response_count/method/GET': 137,
 'playwright/response_count/method/POST': 8,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 23,
 'playwright/response_count/resource_type/other': 1,
 'playwright/response_count/resource_type/script': 86,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 13,
 'response_received_count': 14,
 'scheduler/dequeued': 2034,
 'scheduler/dequeued/memory': 2034,
 'scheduler/enqueued': 2034,
 'scheduler/enqueued/memory': 2034,
 'scrape_type/new': 202,
 'scrape_type/price_update': 261,
 'scrape_type/skipped': 656,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 13,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.2122576900829487,
 'scrapy-zyte-api/mean_response_seconds': 2.3097884373811004,
 'scrapy-zyte-api/processed': 13,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 13,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 13,
 'scrapy-zyte-api/request_args/httpRequestBody': 13,
 'scrapy-zyte-api/request_args/httpRequestMethod': 13,
 'scrapy-zyte-api/request_args/httpResponseBody': 13,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 13,
 'scrapy-zyte-api/request_args/url': 13,
 'scrapy-zyte-api/status_codes/200': 13,
 'scrapy-zyte-api/success': 13,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 27, 22, 45, 6, 848742, tzinfo=datetime.timezone.utc)}
2026-03-27 22:53:16 [scrapy.core.engine] INFO: Spider closed (finished)